-- Logs begin at Thu 2022-07-21 21:42:46 UTC, end at Thu 2022-07-21 23:14:05 UTC. -- Jul 21 22:44:17.064035 dv-cinder-850697-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:44:17.073743 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:44:17 2022] *** Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: nodename: dv-cinder-850697-1-iscsi Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: machine: x86_64 Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: clock source: unix Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: pcre jit disabled Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: detected number of CPU cores: 4 Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: current working directory: / Jul 21 22:44:17.075726 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: your processes number limit is 47680 Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: your memory page size is 4096 bytes Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: detected max file descriptor number: 2048 Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: lock engine: pthread robust mutexes Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: thunder lock: enabled Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:44:17.076448 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:44:17.120054 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: Python main interpreter initialized at 0x55b772cce9c0 Jul 21 22:44:17.120054 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: python threads support enabled Jul 21 22:44:17.120054 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: your server socket listen backlog is limited to 100 connections Jul 21 22:44:17.120054 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:44:17.120376 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:44:17.120456 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: *** Operational MODE: preforking *** Jul 21 22:44:17.120704 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:44:17.120704 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: spawned uWSGI master process (pid: 110385) Jul 21 22:44:17.120881 dv-cinder-850697-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:44:17.123128 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: spawned uWSGI worker 1 (pid: 110386, cores: 1) Jul 21 22:44:17.123128 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: spawned uWSGI worker 2 (pid: 110387, cores: 1) Jul 21 22:44:17.123128 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:44:17.783194 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:44:17.784738 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:44:18.904780 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:44:18.904780 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: from cryptography.utils import int_from_bytes Jul 21 22:44:18.905379 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:44:18.905379 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: from cryptography.utils import int_from_bytes Jul 21 22:44:18.905957 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:44:18.905957 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: from cryptography.utils import int_from_bytes Jul 21 22:44:18.906374 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:44:18.906374 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: from cryptography.utils import int_from_bytes Jul 21 22:44:21.373348 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:44:21.373907 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:44:21.374263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:44:21.374364 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:44:21.374452 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:44:21.374548 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:44:21.374640 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:44:21.374736 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:44:21.374851 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:44:21.374998 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:44:21.375103 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.375346 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.375455 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376235 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376334 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376556 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376657 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376886 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.376979 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377197 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377294 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377515 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377631 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377831 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.377929 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378149 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378247 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378407 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378497 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378720 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.378838 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379063 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379159 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850697-1-iscsi {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379386 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379479 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850697-1-iscsi {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.379779 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380002 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380096 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380313 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380403 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380614 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380768 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.380923 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.381020 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.381223 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.381312 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.381545 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.381730 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382053 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382197 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382366 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382491 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382672 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.382838 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383004 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383118 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383343 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383477 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383661 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383761 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.383972 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384064 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384291 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384381 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384599 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384696 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.384908 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385036 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385217 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385318 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850697-1-iscsi {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385601 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385691 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850697-1-iscsi {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.385912 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386009 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386223 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386314 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386537 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386620 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.386958 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387063 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387268 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387357 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387663 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387896 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.387980 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388210 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388306 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388517 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388607 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388839 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.388925 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389156 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389249 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389473 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389558 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389771 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.389856 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390078 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390191 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390385 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390483 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390691 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.390826 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.391031 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.391128 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.391850 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.391953 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392098 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392184 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392395 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392488 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392706 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.392797 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393023 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393118 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393345 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393498 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393599 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393690 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393827 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.393928 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394142 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394237 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394456 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394550 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394765 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.394897 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395103 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395402 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395504 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395704 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.395799 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396008 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396095 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396314 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396398 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396620 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396714 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.396922 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397008 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397230 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397314 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397542 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397638 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397857 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.397952 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398168 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398259 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398476 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398564 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.398915 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399129 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399222 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399437 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399532 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399757 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.399843 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400082 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400167 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400390 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400485 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400706 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.400798 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401026 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401136 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401331 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401425 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401635 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401727 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.401939 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402034 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402248 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402334 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402572 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402659 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.402898 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403003 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403152 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403244 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403453 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403546 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403756 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.403853 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404064 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404150 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404367 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404465 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404672 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404759 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.404976 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405062 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405275 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405367 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405575 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405664 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405880 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.405971 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.406183 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.406270 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.406488 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.406583 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.406811 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.407527 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.407680 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.407777 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.407987 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408073 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408298 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408394 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408600 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408697 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408903 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.408988 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409223 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409315 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409528 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409631 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409832 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.409918 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410135 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410219 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410438 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410537 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410743 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.410867 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411079 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411245 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411389 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411539 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411689 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411826 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.411961 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412100 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412266 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412399 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412570 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412705 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.412874 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413023 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413164 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413311 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413478 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413816 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.413951 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414084 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414234 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414375 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414516 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414649 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414805 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.414973 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415186 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415346 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415493 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415633 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415725 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415855 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.415950 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416155 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416239 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416455 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416553 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416756 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.416842 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417053 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417146 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417353 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417437 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417657 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417744 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.417964 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418049 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418271 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418353 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418571 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418663 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.418896 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.419014 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.419220 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:44:21.419351 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.419555 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.419683 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.419889 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420026 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420234 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420331 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420554 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420660 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420888 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.420983 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421221 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421313 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421543 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421635 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421860 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.421953 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.422179 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.422275 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.422544 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.422634 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.422885 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423062 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423202 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423379 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423518 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423701 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.423840 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424020 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424163 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424350 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424496 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424815 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.424983 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425132 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425301 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425452 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425611 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425766 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.425932 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426085 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426422 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426587 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426744 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.426925 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427078 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427268 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427420 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427611 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427764 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.427921 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428078 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428253 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428406 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428573 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428728 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.428884 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429041 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429194 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429354 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429504 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429667 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429823 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.429988 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430154 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430321 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430469 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430633 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430809 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.430976 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431126 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431293 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431440 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431608 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431752 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.431920 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432063 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432238 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432373 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432555 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432710 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.432895 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433027 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433213 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433344 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433531 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433657 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433848 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.433975 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434168 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434288 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434484 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434600 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434815 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.434936 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435132 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435238 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435442 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435531 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435752 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.435841 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436059 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436145 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436375 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436463 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436682 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.436776 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437005 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437103 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437321 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437412 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437629 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437712 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.437944 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438142 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438269 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438360 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438582 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438669 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.438917 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439024 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439227 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439319 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439533 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439617 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439843 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.439936 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440151 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440236 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440455 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440545 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440772 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.440858 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441079 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441165 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441384 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441468 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441697 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.441783 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442002 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442085 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442308 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442393 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442616 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442709 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.442946 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443033 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443259 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443356 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443571 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443657 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.443882 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444014 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444196 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444291 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444508 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444593 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444823 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.444910 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445156 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445249 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445461 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445547 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445784 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.445907 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446107 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446201 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446422 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446508 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446726 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.446845 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447059 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447157 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447363 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447449 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447752 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.447970 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448057 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448275 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448360 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448575 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448658 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448878 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.448965 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449181 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449267 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449484 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449786 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.449881 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450094 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450190 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450398 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450481 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450702 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.450837 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451034 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451120 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451341 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451435 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451648 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451737 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.451984 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452068 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452293 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452387 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452639 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452725 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.452955 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.453046 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.453278 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.453379 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.453590 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.453675 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.454413 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.454498 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.454724 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.454837 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455058 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455143 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455369 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455454 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455680 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455774 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.455990 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456076 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456297 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456387 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456611 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456704 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.456918 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457003 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457237 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457322 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457545 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457641 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457861 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.457946 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458163 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458255 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458477 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458562 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458820 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.458920 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459162 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459247 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459478 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459564 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459800 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.459885 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460112 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460211 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460425 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460509 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460732 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.460815 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461042 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461134 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461351 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461435 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461662 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461747 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.461973 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462069 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462280 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462364 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462596 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462679 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.462924 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463023 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463248 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463334 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463557 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463641 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463869 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.463964 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464169 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464259 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464484 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464566 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464800 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.464888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465127 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465218 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465437 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465529 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465747 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.465834 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466059 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466160 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466363 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466456 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466671 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.466758 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467004 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467090 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467306 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467474 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467611 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467698 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.467915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468002 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468226 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468320 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468538 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468631 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468845 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.468930 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.469148 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.469247 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470004 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470097 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470319 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470411 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470625 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470730 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.470954 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471043 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471267 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471365 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471580 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471672 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.471888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472031 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472207 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472357 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472529 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472831 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.472968 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473133 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473265 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473439 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473574 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473749 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.473878 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474053 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474190 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474345 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474502 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474656 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.474867 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475018 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475216 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475389 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475543 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475843 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.475987 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476139 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476283 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476446 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476598 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476741 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.476890 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477043 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477194 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477338 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477490 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477633 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477776 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.477931 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.478344 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.478511 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.478663 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.478827 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.478987 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479142 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479287 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479436 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479581 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479724 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.479933 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480064 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480150 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480237 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480382 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480470 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480691 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480779 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.480999 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481091 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481302 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481387 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481606 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481693 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.481918 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.482002 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.482234 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.482484 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.482812 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.482914 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483143 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483227 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483458 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483551 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483774 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.483865 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484091 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484177 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484412 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484511 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484738 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.484831 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485088 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485172 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485399 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485497 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485712 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.485808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486018 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486105 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486322 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486407 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486628 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486721 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.486970 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487058 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487273 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487358 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487576 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487671 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487882 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.487974 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488183 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488268 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488486 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488579 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488793 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.488877 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489095 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489186 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489397 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489493 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489695 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.489780 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490006 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490136 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490309 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490403 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490614 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490698 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.490948 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.491080 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.493519 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.493664 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.493774 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.493921 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494044 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494161 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494161 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494443 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494443 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494638 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494638 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494864 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.494986 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.495094 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.495199 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.495305 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.495305 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.495970 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496055 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496134 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496212 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496290 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496383 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496463 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496542 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496620 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496697 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496775 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496866 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.496947 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497025 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497104 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497188 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497268 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497354 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497442 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497529 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497609 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497688 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497774 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497855 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.497933 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498011 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498088 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498165 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498252 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498334 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498412 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498490 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498568 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498742 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.498897 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499069 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499163 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499372 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499458 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499680 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499778 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.499986 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500079 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500288 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500391 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500693 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.500923 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501009 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501230 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501316 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501550 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501637 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501858 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.501944 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502162 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502246 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502467 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502554 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502792 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.502880 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503107 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503192 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503414 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503723 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.503815 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504028 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504123 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504332 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504429 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504637 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504724 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.504940 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505034 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505243 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505334 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505549 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505650 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505856 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.505949 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506172 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506257 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506473 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506567 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506794 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.506896 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507105 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507191 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507409 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507493 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507713 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.507799 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508019 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508105 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508320 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508418 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508622 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508708 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.508920 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509006 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509222 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509307 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509523 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509611 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509825 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.509917 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510136 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510220 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510439 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510529 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510742 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.510845 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511070 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511168 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511372 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511456 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511702 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.511786 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512013 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512106 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512348 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512450 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512661 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512747 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.512976 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513068 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513281 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513365 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513590 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513676 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513901 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.513993 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514202 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514287 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514509 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514594 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514837 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.514938 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515151 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515236 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515451 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515575 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515755 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.515843 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.516059 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.516143 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.516885 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.516975 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517199 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517285 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517516 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517601 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517833 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.517919 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518155 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518241 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518457 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518541 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518778 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.518866 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519099 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519185 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519405 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519497 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519715 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.519808 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520028 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520120 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520339 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520479 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520654 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520817 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.520968 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521055 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521285 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521379 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521590 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521897 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.521983 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522201 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522285 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522507 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522609 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522832 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.522922 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523141 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523227 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523456 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523548 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523759 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.523844 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524064 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524147 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524366 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524451 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524671 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524756 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.524972 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.525058 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.525279 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.525400 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.525710 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.525796 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526020 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526112 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526325 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526410 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526632 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526723 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.526967 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527065 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527285 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527369 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527597 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527682 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527903 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.527996 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.528209 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.528317 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.528626 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.528711 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.528936 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529082 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529247 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529377 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529549 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529678 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529852 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.529993 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530156 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530285 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530471 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530598 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530835 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.530981 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531117 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531271 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531403 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531538 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.531824 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.532554 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.532697 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.532846 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.532994 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533173 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533311 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533559 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533704 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533861 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.533998 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.534183 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.534325 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.534566 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.534695 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.534899 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535043 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535228 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535364 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535536 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535673 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535856 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.535954 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536160 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536245 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536475 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536576 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536783 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.536870 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537092 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537185 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537411 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537496 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537721 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.537814 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538033 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538130 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538336 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538429 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538648 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538732 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.538995 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539093 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539310 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539396 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539625 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539720 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.539952 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540040 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540340 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540426 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540654 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540741 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.540976 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541063 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541299 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541383 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541604 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541689 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541910 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.541998 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542216 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542516 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542614 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542843 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.542941 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543152 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543237 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543455 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543553 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543766 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.543854 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544074 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544161 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544381 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544477 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544683 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544770 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.544988 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545072 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545296 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545391 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545600 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545685 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.545918 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546002 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546231 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546325 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546549 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546633 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546903 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.546993 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547236 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547332 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547572 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547665 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547880 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.547979 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548188 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548275 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548493 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548577 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548796 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.548881 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549101 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549194 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549438 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549530 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549748 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.549833 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550071 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550158 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550397 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550481 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550709 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.550828 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551051 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551136 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551382 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551466 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551699 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.551794 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552013 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552097 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552333 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552419 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552639 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552733 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.552943 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553046 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553245 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553546 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553639 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553851 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.553936 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554152 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554245 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554456 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554541 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554756 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.554860 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555080 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555164 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555381 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555467 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555683 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555768 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.555993 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556080 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556302 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556387 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556611 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556697 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.556915 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557009 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557221 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557308 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557523 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557610 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557824 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.557922 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558156 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558242 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558468 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558552 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558805 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.558906 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559138 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559223 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559464 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559556 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559775 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.559872 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560088 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560172 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560404 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560488 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560720 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.560809 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561036 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561137 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561349 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561436 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561664 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561754 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.561976 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562061 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562290 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562377 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562602 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562691 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.562932 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563018 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563271 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563359 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563586 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563673 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.563905 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.564105 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.564422 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.564515 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.564737 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.564823 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565052 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565138 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565363 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565458 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565674 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565759 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.565983 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566106 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566295 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566396 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566603 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.566936 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567036 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567248 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567348 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567557 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567643 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567885 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.567969 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568205 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568293 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568532 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568619 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568846 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.568938 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569168 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569256 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569482 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569566 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569793 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.569887 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570106 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570191 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570450 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570535 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570757 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.570874 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571088 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571184 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571399 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571486 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571714 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.571801 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572023 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572117 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572332 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572418 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572641 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572734 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.572951 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573036 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573261 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573346 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573571 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573658 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573881 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.573973 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574191 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574284 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574503 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574587 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574853 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.574956 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575171 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575352 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575487 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575573 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575800 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.575892 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.576114 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.576260 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.576431 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.576628 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.576945 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577030 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577264 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577357 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577589 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577712 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.577915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.578001 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.578230 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.578317 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.578547 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.578633 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.579403 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.579500 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.579720 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.579810 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580026 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580111 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580336 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580422 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580645 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580733 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.580949 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581076 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581271 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581358 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581579 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581668 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581884 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.581980 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.582193 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.582293 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.582502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.582587 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.582842 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.583058 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.583373 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.583469 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.583711 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.583795 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584028 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584112 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584350 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584444 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584668 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584761 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.584974 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585059 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585281 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585368 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585588 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585680 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585894 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.585986 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586199 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586331 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586507 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586592 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586829 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.586917 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587135 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587232 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587441 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587526 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587745 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.587829 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588134 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588350 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588434 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588649 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588746 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.588953 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589039 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589266 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589353 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589575 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589675 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589880 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.589965 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590186 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590272 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590487 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590581 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590810 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.590947 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591124 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591234 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591425 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591533 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591728 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.591847 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592029 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592124 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592330 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592427 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592632 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592720 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.592937 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593024 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593243 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593342 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593546 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593640 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593857 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.593944 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.594200 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.594294 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595061 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595157 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595369 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595459 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595673 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595770 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.595984 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596078 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596309 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596393 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596605 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596708 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.596918 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597007 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597229 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597323 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597565 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597650 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.597886 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.598098 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.598417 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.598515 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.598749 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.598857 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599095 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599193 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599428 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599523 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599743 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.599829 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600054 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600140 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600360 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600447 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600665 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600750 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.600983 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601069 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601381 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601689 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601913 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.601998 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602221 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602308 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602529 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602614 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602860 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.602950 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.603439 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.603547 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.603747 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.603833 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604053 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604149 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604361 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604454 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604761 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.604973 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605071 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605281 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605367 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605600 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605687 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.605922 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606012 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606239 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606328 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606553 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606642 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606888 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.606988 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607201 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607287 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607512 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607597 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607821 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.607916 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608131 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608218 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608443 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608538 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608762 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.608850 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609076 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609161 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609382 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609477 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609696 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.609789 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610125 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610218 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610445 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610542 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610765 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.610893 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611097 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611183 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611412 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611513 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611733 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.611819 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612044 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612139 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612358 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612444 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612666 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612753 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.612978 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613072 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613309 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613397 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613640 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613739 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.613962 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614062 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614271 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614359 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614577 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614665 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.614904 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615008 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615213 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615301 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615526 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615613 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615835 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.615936 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616139 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616227 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616444 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616537 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616748 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.616847 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617048 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617135 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617351 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617437 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617652 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617783 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.617958 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618044 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618350 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618567 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618655 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618893 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.618985 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619198 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619283 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619503 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619593 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619804 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.619890 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620106 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620191 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620411 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620499 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620720 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.620806 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621025 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621114 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621331 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621420 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621636 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621740 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.621943 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622039 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622248 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622343 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622579 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622667 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.622926 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623245 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623330 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623621 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623723 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623872 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.623999 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624177 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624268 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624491 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624577 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624810 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.624905 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.625125 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.625212 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.625435 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.625525 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.625792 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626062 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626149 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626436 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626529 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626751 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.626878 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627087 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627181 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627398 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627483 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627707 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.627801 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628021 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628107 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628334 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628421 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628638 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628725 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.628966 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629061 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629272 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629365 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629597 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629784 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.629913 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630000 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630213 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630305 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630526 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630613 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630863 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.630967 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631178 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631277 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631489 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631591 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631802 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.631897 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632110 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632224 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632423 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632521 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632729 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.632815 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633042 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633138 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633351 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633436 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633665 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633751 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.633983 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634394 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634621 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634708 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.634973 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635074 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635301 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635430 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635643 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635729 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.635954 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636041 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636298 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636395 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636612 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636703 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.636929 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637027 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637238 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637333 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637545 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637660 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.637789 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:44:21.637890 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.638187 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:44:21.638433 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:44:21.700131 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO dbcounter [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Registered counter for database nova_api Jul 21 22:44:21.701124 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO dbcounter [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Registered counter for database nova_api Jul 21 22:44:21.812287 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_db.sqlalchemy.engines [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.819234 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writer thread running {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:21.822291 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_db.sqlalchemy.engines [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.828614 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writer thread running {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:21.878829 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.context [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efb1614c-6e53-4961-af0f-ea703c25657e(cell1) {{(pid=110387) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:44:21.882678 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.884254 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.885054 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.885767 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.context [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efb1614c-6e53-4961-af0f-ea703c25657e(cell1) {{(pid=110386) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:44:21.887214 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.889178 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO dbcounter [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Registered counter for database nova_cell0 Jul 21 22:44:21.889680 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_concurrency.lockutils [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.891425 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_concurrency.lockutils [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.892088 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_concurrency.lockutils [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.893377 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO dbcounter [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Registered counter for database nova_cell1 Jul 21 22:44:21.894211 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_concurrency.lockutils [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.896218 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO dbcounter [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Registered counter for database nova_cell0 Jul 21 22:44:21.900080 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO dbcounter [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Registered counter for database nova_cell1 Jul 21 22:44:21.901236 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_db.sqlalchemy.engines [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.903869 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_db.sqlalchemy.engines [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.908026 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_db.sqlalchemy.engines [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.909712 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_db.sqlalchemy.engines [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:21.909827 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writer thread running {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:21.911326 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writer thread running {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:21.915212 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writer thread running {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:21.920341 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writer thread running {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:22.054797 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO dbcounter [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Registered counter for database nova_cell0 Jul 21 22:44:22.062637 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO dbcounter [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Registered counter for database nova_cell0 Jul 21 22:44:22.064062 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_db.sqlalchemy.engines [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:22.068427 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writer thread running {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:22.072321 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG oslo_db.sqlalchemy.engines [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:44:22.077238 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writer thread running {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:44:22.504318 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: WARNING keystonemiddleware.auth_token [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:44:22.511631 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: WARNING keystonemiddleware.auth_token [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:44:22.527583 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: WARNING keystonemiddleware.auth_token [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:44:22.535476 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: WARNING keystonemiddleware.auth_token [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:44:22.848092 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: WARNING keystonemiddleware.auth_token [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:44:22.854347 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: WARNING keystonemiddleware.auth_token [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:44:22.859605 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b772cce9c0 pid: 110387 (default app) Jul 21 22:44:22.862201 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:22.863413 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jul 21 22:44:22.863816 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Jul 21 22:44:22 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:22.876719 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: WARNING keystonemiddleware.auth_token [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:44:22.882814 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: WARNING keystonemiddleware.auth_token [None req-160e78f9-5079-498f-af76-f16497b7ef67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:44:22.888064 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b772cce9c0 pid: 110386 (default app) Jul 21 22:45:41.836372 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:41.837388 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 21 22:45:41.837952 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:41.850696 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_api:SELECT=3 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:41.851617 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_cell1:SELECT=3 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:41.852608 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_cell0:SELECT=3 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:41.853380 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:42.709585 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-5a49e2b5-26d7-404c-96be-e60a0ddecbd5 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:42.745661 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-5a49e2b5-26d7-404c-96be-e60a0ddecbd5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.900283 Jul 21 22:45:42.746401 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 21 22:45:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:45.008208 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:45.009209 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-dcfa2f3d-e153-4a46-b286-9887ef5c4287 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 21 22:45:45.009981 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:45.439341 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-07d103e4-fc53-4fb1-8df1-59eae12be6b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:45.461079 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:45:45.461079 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: warnings.warn(msg) Jul 21 22:45:45.548932 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-07d103e4-fc53-4fb1-8df1-59eae12be6b0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533164 Jul 21 22:45:45.550565 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:45:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:45:45.563828 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_api:SELECT=3 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:45.565196 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_cell0:SELECT=3 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:45.566119 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_cell1:SELECT=3 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:45.567070 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:45.782208 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-2f209ef7-99ac-477d-b2bd-dd5f4ac5495d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:45.784869 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:45:45.784869 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:45:45.906909 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-2f209ef7-99ac-477d-b2bd-dd5f4ac5495d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349066 Jul 21 22:45:45.908017 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 21 22:45:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:48.150374 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-07d103e4-fc53-4fb1-8df1-59eae12be6b0 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:48.151433 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-07d103e4-fc53-4fb1-8df1-59eae12be6b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 21 22:45:48.152054 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:48.819984 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-1509ad3a-1840-4a9e-ad88-4dad491e6db4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:48.838762 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:45:48.838762 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:45:48.943231 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-1509ad3a-1840-4a9e-ad88-4dad491e6db4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.784832 Jul 21 22:45:48.943986 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:45:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:45:48.956212 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-071c2ac7-b9d2-495d-a16f-4c824322f106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:48.957699 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:45:48.957699 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: warnings.warn(msg) Jul 21 22:45:49.066075 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-071c2ac7-b9d2-495d-a16f-4c824322f106 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113366 Jul 21 22:45:49.066586 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 21 22:45:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:51.338856 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-1509ad3a-1840-4a9e-ad88-4dad491e6db4 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:51.339865 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-1509ad3a-1840-4a9e-ad88-4dad491e6db4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 21 22:45:51.340303 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:51.744123 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-14e6f83c-7fe9-44bf-a339-ab37798eb389 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:51.810675 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-14e6f83c-7fe9-44bf-a339-ab37798eb389 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464553 Jul 21 22:45:51.811242 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:45:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:45:51.823212 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-c4f97a88-f2ab-4b3a-807e-ccfc2425a19b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:51.898852 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-c4f97a88-f2ab-4b3a-807e-ccfc2425a19b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079189 Jul 21 22:45:51.899419 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 21 22:45:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:54.166179 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-14e6f83c-7fe9-44bf-a339-ab37798eb389 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:54.167243 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-14e6f83c-7fe9-44bf-a339-ab37798eb389 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 21 22:45:54.167645 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:54.647713 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-e6eeefb8-f4b1-443f-808c-ff5b70791ba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 10, "name": "ds2G"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:54.724924 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-e6eeefb8-f4b1-443f-808c-ff5b70791ba9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550769 Jul 21 22:45:54.725669 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:45:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:45:54.738232 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-57058b3b-13c3-4bf7-a563-741c888c19b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:54.797547 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-57058b3b-13c3-4bf7-a563-741c888c19b9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062932 Jul 21 22:45:54.798137 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 21 22:45:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:57.032088 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-e6eeefb8-f4b1-443f-808c-ff5b70791ba9 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:57.033680 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-e6eeefb8-f4b1-443f-808c-ff5b70791ba9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jul 21 22:45:57.034229 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:45:57.473258 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:57.529993 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489950 Jul 21 22:45:57.530713 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:45:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:45:57.542391 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-23d6c5e6-7094-4011-bddd-f8fe0a92bcfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:45:57.613465 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-23d6c5e6-7094-4011-bddd-f8fe0a92bcfc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074633 Jul 21 22:45:57.614083 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Jul 21 22:45:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:00.219366 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:00.220519 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Jul 21 22:46:00.220959 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:00.649976 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-02daf8eb-0437-47cd-96e4-254aa066cd77 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:00.673507 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-02daf8eb-0437-47cd-96e4-254aa066cd77 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444861 Jul 21 22:46:00.674079 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 21 22:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:02.957690 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:02.958709 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-5d8f43f5-f7a0-4268-9d1d-1b9763462ae7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 21 22:46:02.959145 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:46:03.396940 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-9c67f31e-a7cf-4a34-9bfd-685447b3dfe3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:03.472339 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-9c67f31e-a7cf-4a34-9bfd-685447b3dfe3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.507192 Jul 21 22:46:03.472843 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:46:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:03.487681 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-0a70613d-7844-431d-adb8-0dd07f06de4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:03.574349 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-0a70613d-7844-431d-adb8-0dd07f06de4d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091556 Jul 21 22:46:03.575227 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 21 22:46:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:05.782798 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-9c67f31e-a7cf-4a34-9bfd-685447b3dfe3 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:05.783869 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-9c67f31e-a7cf-4a34-9bfd-685447b3dfe3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 21 22:46:05.784271 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:06.183225 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-362d7f47-481d-4dd7-b921-732fb4b66fde admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "disk": 20}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:06.249536 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-362d7f47-481d-4dd7-b921-732fb4b66fde admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459210 Jul 21 22:46:06.250094 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:46:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:06.262236 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-527183dd-1019-43fd-8f26-2d0916725030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:06.328061 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-527183dd-1019-43fd-8f26-2d0916725030 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069427 Jul 21 22:46:06.328631 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 21 22:46:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:08.594588 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-362d7f47-481d-4dd7-b921-732fb4b66fde admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:08.595656 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-362d7f47-481d-4dd7-b921-732fb4b66fde admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 21 22:46:08.596063 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:08.991108 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-e5172dde-2948-49ca-bdc2-d6c7f5da202d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "disk": 40}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:09.118109 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-e5172dde-2948-49ca-bdc2-d6c7f5da202d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.516063 Jul 21 22:46:09.118671 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:46:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:09.131138 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-c9f5d33c-47dc-4418-b1af-7275f1c67528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:09.201139 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-c9f5d33c-47dc-4418-b1af-7275f1c67528 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073910 Jul 21 22:46:09.201720 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 21 22:46:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:11.477694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-e5172dde-2948-49ca-bdc2-d6c7f5da202d admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:11.478694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-e5172dde-2948-49ca-bdc2-d6c7f5da202d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jul 21 22:46:11.479111 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:11.963774 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-30a3ecab-fe26-4bbb-990d-66b08da451df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:12.490182 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:12.505535 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-30a3ecab-fe26-4bbb-990d-66b08da451df admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.020359 Jul 21 22:46:12.506297 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:46:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:12.519136 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-c624cff2-59ea-4f31-912d-f65bebd15517 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:12.609347 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-c624cff2-59ea-4f31-912d-f65bebd15517 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094109 Jul 21 22:46:12.610406 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 21 22:46:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:14.868040 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-30a3ecab-fe26-4bbb-990d-66b08da451df admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:14.869040 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-30a3ecab-fe26-4bbb-990d-66b08da451df admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 22:46:14.871281 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:15.309390 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 16384}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:15.381408 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.502655 Jul 21 22:46:15.382427 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Jul 21 22:46:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:15.394114 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-394bcc15-b3f2-47f8-bc9c-2462a8629639 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:15.476510 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-394bcc15-b3f2-47f8-bc9c-2462a8629639 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085846 Jul 21 22:46:15.477304 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Jul 21 22:46:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:46:35.803506 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:35.804543 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 21 22:46:35.804946 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:36.192303 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-2e13d9f9-e8ba-4ed4-865e-aee7c45362ba admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:36.208814 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-2e13d9f9-e8ba-4ed4-865e-aee7c45362ba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397924 Jul 21 22:46:36.209336 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 21 22:46:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:37.263776 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:37.264779 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-ee126d48-1316-455f-a734-d159a5bbee82 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 21 22:46:37.265181 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:37.786576 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-8f5ef441-76bb-467b-86c6-4e7fc156b123 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:37.792912 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.wsgi [None req-8f5ef441-76bb-467b-86c6-4e7fc156b123 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-8f5ef441-76bb-467b-86c6-4e7fc156b123 admin admin] Request method failure captured: Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept: application/json Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept-Encoding: gzip, deflate Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Connection: keep-alive Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Content-Length: 0 Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Host: 10.222.0.52 Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-System-Scope: None Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: User-Agent: python-novaclient Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Auth-Token: gAAAAABi2ddNuQBGZt4ui08feZWr-6YNK94jD027C0NeMtblQ7HMqxoIVwhY9WQkkrhIy1OaM6svfWwZUcShiFuyRsnAJ-d2XEF-_aB2ZBoDUfQZ5ab7t3sZDLr0a0EjKTWMozmzk3DjcZWDq8TUL3GrpJ4GfsOCjisBm-4Ke4rXSzSbpMtsZik Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Id: None Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Name: None Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Identity-Status: Confirmed Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Is-Admin-Project: True Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Id: default Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Name: Default Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Name: admin Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Role: member,reader,admin Jul 21 22:46:37.796171 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Roles: member,reader,admin Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant: admin Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Name: admin Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User: admin Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Id: default Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Name: Default Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Name: admin Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: method: > Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: exception: Flavor 42 could not be found. Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: action_args: {'id': '42'} Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:37.797808 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:37.798813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.800172 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-8f5ef441-76bb-467b-86c6-4e7fc156b123 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:37.801567 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-8f5ef441-76bb-467b-86c6-4e7fc156b123 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397031 Jul 21 22:46:37.801567 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 21 22:46:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:37.807220 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-55556158-188d-4dc2-bd5c-14627c7c1071 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:37.811185 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:37.830062 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-55556158-188d-4dc2-bd5c-14627c7c1071 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026356 Jul 21 22:46:37.830631 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:37.841160 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-21b54ac2-39d1-4979-95f0-d91d6e236172 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:37.862289 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-21b54ac2-39d1-4979-95f0-d91d6e236172 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025320 Jul 21 22:46:37.864953 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:37.872708 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-2e26cb13-f9b1-4863-910e-b4cdf97140e4 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:37.878417 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.wsgi [None req-2e26cb13-f9b1-4863-910e-b4cdf97140e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-2e26cb13-f9b1-4863-910e-b4cdf97140e4 admin admin] Request method failure captured: Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept: application/json Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept-Encoding: gzip, deflate Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Connection: keep-alive Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Content-Length: 0 Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Host: 10.222.0.52 Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-System-Scope: None Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: User-Agent: python-novaclient Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Auth-Token: gAAAAABi2ddNuQBGZt4ui08feZWr-6YNK94jD027C0NeMtblQ7HMqxoIVwhY9WQkkrhIy1OaM6svfWwZUcShiFuyRsnAJ-d2XEF-_aB2ZBoDUfQZ5ab7t3sZDLr0a0EjKTWMozmzk3DjcZWDq8TUL3GrpJ4GfsOCjisBm-4Ke4rXSzSbpMtsZik Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Id: None Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Name: None Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Identity-Status: Confirmed Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Is-Admin-Project: True Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Id: default Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Name: Default Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Name: admin Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Role: member,reader,admin Jul 21 22:46:37.881718 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Roles: member,reader,admin Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant: admin Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Name: admin Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User: admin Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Id: default Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Name: Default Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Name: admin Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: method: > Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: exception: Flavor 42 could not be found. Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: action_args: {'id': '42'} Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:37.883308 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:37.884176 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:37.886047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-2e26cb13-f9b1-4863-910e-b4cdf97140e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:37.888076 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-2e26cb13-f9b1-4863-910e-b4cdf97140e4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014365 Jul 21 22:46:37.888076 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 21 22:46:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:38.852947 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-21b54ac2-39d1-4979-95f0-d91d6e236172 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:38.853983 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-21b54ac2-39d1-4979-95f0-d91d6e236172 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 21 22:46:38.854378 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:39.385389 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-52d3af95-55b0-4651-a3f7-dd60e31c03da admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:39.391517 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.wsgi [None req-52d3af95-55b0-4651-a3f7-dd60e31c03da admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-52d3af95-55b0-4651-a3f7-dd60e31c03da admin admin] Request method failure captured: Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept: application/json Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept-Encoding: gzip, deflate Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Connection: keep-alive Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Content-Length: 0 Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Host: 10.222.0.52 Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-System-Scope: None Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: User-Agent: python-novaclient Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Auth-Token: gAAAAABi2ddOJe80IqZlQ0WaolwLadW12pu85RZc-du9Y_c7J2AWMw-2OJr9wn-Gb0pytt3pMFll8BifLx39zR5zo51LxNMyCCid9xai-nUamWZvc4RpM6pbPrTK6nBgTbUloXwEOWqB2pypgbOQsmJ_aGTmBBXkLddY9bgubrjE3Jq-uwerCww Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Id: None Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Name: None Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Identity-Status: Confirmed Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Is-Admin-Project: True Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Id: default Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Name: Default Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Name: admin Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Role: member,reader,admin Jul 21 22:46:39.393329 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Roles: member,reader,admin Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant: admin Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Name: admin Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User: admin Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Id: default Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Name: Default Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Name: admin Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: method: > Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: exception: Flavor 84 could not be found. Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: action_args: {'id': '84'} Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:39.394650 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:39.395603 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.396888 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-52d3af95-55b0-4651-a3f7-dd60e31c03da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:39.398162 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-52d3af95-55b0-4651-a3f7-dd60e31c03da admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403981 Jul 21 22:46:39.398162 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 21 22:46:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:39.409812 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-8dde8814-032b-4d86-9c38-e5607b79a581 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:39.424761 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-8dde8814-032b-4d86-9c38-e5607b79a581 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023194 Jul 21 22:46:39.425159 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:39.435024 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-77636ad3-922e-4ff2-9c0b-1d9ca9049b09 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:39.450453 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-77636ad3-922e-4ff2-9c0b-1d9ca9049b09 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019102 Jul 21 22:46:39.451064 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:46:39.460202 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-3883fd99-5741-4756-bca3-9d0a307178c9 admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:39.466144 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.wsgi [None req-3883fd99-5741-4756-bca3-9d0a307178c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-3883fd99-5741-4756-bca3-9d0a307178c9 admin admin] Request method failure captured: Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept: application/json Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept-Encoding: gzip, deflate Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Connection: keep-alive Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Content-Length: 0 Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Host: 10.222.0.52 Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-System-Scope: None Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: User-Agent: python-novaclient Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Auth-Token: gAAAAABi2ddOJe80IqZlQ0WaolwLadW12pu85RZc-du9Y_c7J2AWMw-2OJr9wn-Gb0pytt3pMFll8BifLx39zR5zo51LxNMyCCid9xai-nUamWZvc4RpM6pbPrTK6nBgTbUloXwEOWqB2pypgbOQsmJ_aGTmBBXkLddY9bgubrjE3Jq-uwerCww Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Id: None Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Name: None Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Identity-Status: Confirmed Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Is-Admin-Project: True Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Id: default Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Name: Default Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Name: admin Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Role: member,reader,admin Jul 21 22:46:39.467688 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Roles: member,reader,admin Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant: admin Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Name: admin Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User: admin Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Id: default Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Name: Default Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Name: admin Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: method: > Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: exception: Flavor 84 could not be found. Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: action_args: {'id': '84'} Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:39.469189 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:39.470295 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:39.471726 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-3883fd99-5741-4756-bca3-9d0a307178c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:39.472952 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-3883fd99-5741-4756-bca3-9d0a307178c9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012300 Jul 21 22:46:39.472952 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Jul 21 22:46:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:40.433544 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-77636ad3-922e-4ff2-9c0b-1d9ca9049b09 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.434578 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-77636ad3-922e-4ff2-9c0b-1d9ca9049b09 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 21 22:46:40.435014 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:40.956201 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d56e50e0-b3a9-4478-917e-b11cf0973f4c admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.961894 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.wsgi [None req-d56e50e0-b3a9-4478-917e-b11cf0973f4c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d56e50e0-b3a9-4478-917e-b11cf0973f4c admin admin] Request method failure captured: Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept: application/json Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Accept-Encoding: gzip, deflate Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Connection: keep-alive Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Content-Length: 0 Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Host: 10.222.0.52 Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Openstack-System-Scope: None Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: User-Agent: python-novaclient Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Auth-Token: gAAAAABi2ddQhzd3moy8kVM1vxD6B9eTwRjSKUlwt0u--QQMUMs0TShxICI82_zXxngLx2oQoNxisJqtKuVyOrfibTDkQr0gfTnRVUBhvafm75Zi4NOcQPkHJfb7qTaCbkInr9p5cvuUaQwXqheKDmOTO2xLLJBzaditXgMPEWNjj3JYid_NU7M Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Id: None Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Domain-Name: None Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Identity-Status: Confirmed Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Is-Admin-Project: True Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Id: default Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Domain-Name: Default Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Project-Name: admin Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Role: member,reader,admin Jul 21 22:46:40.964029 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Roles: member,reader,admin Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant: admin Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-Tenant-Name: admin Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User: admin Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Id: default Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Domain-Name: Default Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: X-User-Name: admin Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: method: > Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: exception: Flavor 451 could not be found. Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: action_args: {'id': '451'} Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:40.965607 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:40.966577 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: ERROR nova.api.openstack.wsgi Jul 21 22:46:40.967915 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d56e50e0-b3a9-4478-917e-b11cf0973f4c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:40.969096 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d56e50e0-b3a9-4478-917e-b11cf0973f4c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394485 Jul 21 22:46:40.969096 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:40.975040 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-4134fb91-f2dc-476b-ac55-1db4d03cab86 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.989022 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-4134fb91-f2dc-476b-ac55-1db4d03cab86 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017607 Jul 21 22:46:40.989550 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:40.998653 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:41.013637 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018515 Jul 21 22:46:41.014150 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:46:41.023150 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-5bd5b82a-d606-440a-a7d2-c08a890161f4 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:41.029008 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.wsgi [None req-5bd5b82a-d606-440a-a7d2-c08a890161f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-5bd5b82a-d606-440a-a7d2-c08a890161f4 admin admin] Request method failure captured: Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept: application/json Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Accept-Encoding: gzip, deflate Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Connection: keep-alive Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Content-Length: 0 Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Host: 10.222.0.52 Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-Api-Version: compute 2.90 Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Openstack-System-Scope: None Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: User-Agent: python-novaclient Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Auth-Token: gAAAAABi2ddQhzd3moy8kVM1vxD6B9eTwRjSKUlwt0u--QQMUMs0TShxICI82_zXxngLx2oQoNxisJqtKuVyOrfibTDkQr0gfTnRVUBhvafm75Zi4NOcQPkHJfb7qTaCbkInr9p5cvuUaQwXqheKDmOTO2xLLJBzaditXgMPEWNjj3JYid_NU7M Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Id: None Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Domain-Name: None Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Identity-Status: Confirmed Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Is-Admin-Project: True Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Id: default Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Domain-Name: Default Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Project-Name: admin Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Role: member,reader,admin Jul 21 22:46:41.030502 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Roles: member,reader,admin Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d47c52ce443d40eaa4e635852fb964cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d47c52ce443d40eaa4e635852fb964cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant: admin Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Id: d47c52ce443d40eaa4e635852fb964cd Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-Tenant-Name: admin Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User: admin Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Id: default Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Domain-Name: Default Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Id: 031023a71a014731ad7c782eb926f065 Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: X-User-Name: admin Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: method: > Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: exception: Flavor 451 could not be found. Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: action_args: {'id': '451'} Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:46:41.032071 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:41.032985 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: ERROR nova.api.openstack.wsgi Jul 21 22:46:41.034263 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-5bd5b82a-d606-440a-a7d2-c08a890161f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:46:41.035501 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-5bd5b82a-d606-440a-a7d2-c08a890161f4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012185 Jul 21 22:46:41.035501 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:46:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 22:46:42.001449 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:42.002461 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 22:46:42.002912 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:42.522187 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-76136a10-c971-4e49-b867-cff42909e858 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:42.584735 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-76136a10-c971-4e49-b867-cff42909e858 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.444334 Jul 21 22:46:42.585277 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 21 22:46:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:43.552878 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:43.553958 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 21 22:46:43.554439 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:44.077981 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-35999164-00ea-48d9-a8ac-a7554353b705 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:44.157129 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-35999164-00ea-48d9-a8ac-a7554353b705 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463758 Jul 21 22:46:44.157687 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 21 22:46:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:45.135313 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:45.136304 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 21 22:46:45.136702 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:45.658660 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-5c3245e4-d89a-4dc0-9efa-e8a0d11e2f21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:45.727511 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-5c3245e4-d89a-4dc0-9efa-e8a0d11e2f21 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.454118 Jul 21 22:46:45.728073 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 21 22:46:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:46.692108 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:46.693099 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 21 22:46:46.693493 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:47.227836 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-f9713cf9-0625-47c9-99aa-56dbb837e26c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:47.283895 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-f9713cf9-0625-47c9-99aa-56dbb837e26c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.453896 Jul 21 22:46:47.284433 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Jul 21 22:46:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:46:48.258800 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:48.259813 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 22:46:48.260216 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:48.791374 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-b3ddb8dd-fd9d-4d1e-95b6-2da4cf4b2c3a admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:48.808188 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-b3ddb8dd-fd9d-4d1e-95b6-2da4cf4b2c3a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409252 Jul 21 22:46:48.809706 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Jul 21 22:46:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:47:41.555178 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:41.556162 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-d77c8977-8fab-4acc-bc52-40918d7126ad admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 21 22:47:41.556547 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Thu Jul 21 22:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:47:41.567047 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:41.952576 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-5d190c80-153a-4ac1-8fe4-19e5c6a27ac7 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:41.969482 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-5d190c80-153a-4ac1-8fe4-19e5c6a27ac7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406967 Jul 21 22:47:41.970063 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Jul 21 22:47:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:47:41.991754 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG dbcounter [-] [110386] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:41.995407 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-783f8386-f4c8-4a91-8091-dd808373363e admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.003061 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-783f8386-f4c8-4a91-8091-dd808373363e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013255 Jul 21 22:47:42.003574 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jul 21 22:47:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:42.016091 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-789d0d5a-40a1-4e27-a4d5-c33baff25367 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.024268 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-789d0d5a-40a1-4e27-a4d5-c33baff25367 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011841 Jul 21 22:47:42.024786 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jul 21 22:47:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:42.036219 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.044696 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012111 Jul 21 22:47:42.045210 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Jul 21 22:47:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:42.056512 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-a299ca3e-38f5-4fcd-98cb-570deb7e0db7 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.064095 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-a299ca3e-38f5-4fcd-98cb-570deb7e0db7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011148 Jul 21 22:47:42.064610 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Jul 21 22:47:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:09.893056 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:09.894069 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 21 22:51:09.894498 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:51:10.036195 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_api:SELECT=6 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:10.192106 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:10.193274 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:51:10.193274 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:51:10.194506 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.194993 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.195782 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.196211 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.238905 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-457d48a6-50d8-44f3-b86b-5882b62c0675 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204159 Jul 21 22:51:10.239464 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:51:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:51:11.059237 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:11.060234 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 21 22:51:11.060788 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:51:11.248554 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:11.249711 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:51:11.249711 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:51:11.250911 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.251396 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.252166 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.252585 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.271969 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-b4776394-13ae-450a-9267-e5599d7e7456 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074795 Jul 21 22:51:11.272447 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:51:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:51:22.508895 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:22.509892 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 21 22:51:22.510286 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:51:22.654823 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_cell0:SELECT=4 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:22.655553 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_cell1:SELECT=4 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:22.660763 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG dbcounter [-] [110387] Writing DB stats nova_api:SELECT=8 {{(pid=110387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:22.707773 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:22.708953 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:51:22.708953 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:51:22.710134 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.710598 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.711416 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.711842 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.738365 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-6636a714-5b52-44d1-85a1-f7f53bdbd42c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087924 Jul 21 22:51:22.738877 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:51:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:23.563640 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: DEBUG nova.api.openstack.wsgi [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] Calling method '>' {{(pid=110386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:23.564650 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: INFO nova.api.openstack.requestlog [None req-f36249ff-3152-44f3-9031-4554e22357bb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 21 22:51:23.565053 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: [pid: 110386|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Jul 21 22:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:51:23.757694 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG nova.api.openstack.wsgi [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] Calling method '>' {{(pid=110387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:23.758899 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:51:23.758899 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: warnings.warn(msg) Jul 21 22:51:23.760084 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.760527 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.761349 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.761775 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: DEBUG oslo_concurrency.lockutils [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.783956 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: INFO nova.api.openstack.requestlog [None req-3f12d9b6-9ad9-47df-83e7-ee54065f4a54 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078314 Jul 21 22:51:23.784504 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: [pid: 110387|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Jul 21 22:51:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:20.747167 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: Thu Jul 21 22:52:20 2022 - graceful shutdown triggered... Jul 21 22:52:20.747661 dv-cinder-850697-1-iscsi devstack@n-api.service[110386]: Gracefully killing worker 1 (pid: 110386)... Jul 21 22:52:20.748851 dv-cinder-850697-1-iscsi devstack@n-api.service[110387]: Gracefully killing worker 2 (pid: 110387)... Jul 21 22:52:20.751104 dv-cinder-850697-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 22:52:21.748307 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: worker 1 buried after 1 seconds Jul 21 22:52:21.748307 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: worker 2 buried after 1 seconds Jul 21 22:52:21.748307 dv-cinder-850697-1-iscsi devstack@n-api.service[110385]: goodbye to uWSGI. Jul 21 22:52:21.749893 dv-cinder-850697-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 22:52:21.750447 dv-cinder-850697-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 22:52:21.753316 dv-cinder-850697-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:52:21.762886 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:52:21.765456 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:52:21 2022] *** Jul 21 22:52:21.765606 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:52:21.765740 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:52:21.765867 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: nodename: dv-cinder-850697-1-iscsi Jul 21 22:52:21.765985 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: machine: x86_64 Jul 21 22:52:21.766097 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: clock source: unix Jul 21 22:52:21.766204 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: pcre jit disabled Jul 21 22:52:21.766311 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: detected number of CPU cores: 4 Jul 21 22:52:21.766418 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: current working directory: / Jul 21 22:52:21.766533 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:52:21.766670 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: your processes number limit is 47680 Jul 21 22:52:21.766670 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: your memory page size is 4096 bytes Jul 21 22:52:21.766670 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: detected max file descriptor number: 2048 Jul 21 22:52:21.766670 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: lock engine: pthread robust mutexes Jul 21 22:52:21.767021 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: thunder lock: enabled Jul 21 22:52:21.767093 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:52:21.767186 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:52:21.815563 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: Python main interpreter initialized at 0x55710b7789c0 Jul 21 22:52:21.815563 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: python threads support enabled Jul 21 22:52:21.815563 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: your server socket listen backlog is limited to 100 connections Jul 21 22:52:21.815563 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:52:21.816017 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:52:21.816017 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: *** Operational MODE: preforking *** Jul 21 22:52:21.816280 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:52:21.816280 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: spawned uWSGI master process (pid: 124904) Jul 21 22:52:21.816487 dv-cinder-850697-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:52:21.817049 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: spawned uWSGI worker 1 (pid: 124924, cores: 1) Jul 21 22:52:21.817547 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: spawned uWSGI worker 2 (pid: 124925, cores: 1) Jul 21 22:52:21.817822 dv-cinder-850697-1-iscsi devstack@n-api.service[124904]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:52:22.480978 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:52:22.485496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:52:23.679815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:52:23.679815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: from cryptography.utils import int_from_bytes Jul 21 22:52:23.680445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:52:23.680445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: from cryptography.utils import int_from_bytes Jul 21 22:52:23.688495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:52:23.688495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: from cryptography.utils import int_from_bytes Jul 21 22:52:23.689037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:52:23.689037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: from cryptography.utils import int_from_bytes Jul 21 22:52:25.977475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:52:25.977936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:52:25.978267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:52:25.978630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:52:25.978918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:52:25.979310 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.979668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.979993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.980316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.980647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.980960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.981283 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.981602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.981929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.982189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.982506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.982853 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850697-1-iscsi {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.983177 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.983486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.983796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.984122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.984432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.984755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.985077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.985558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.985992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.986298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.986611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.986974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.987288 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.987602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.987922 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.988230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.988558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.988869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.989274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850697-1-iscsi {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.989598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.989912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.990227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.990643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.990984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.991300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.991623 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.991947 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.992257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.992585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.992906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.993223 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.993542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.993844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.994158 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.994470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.994808 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.995642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.995949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.996200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.996508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.996831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.997154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.997475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.997726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.997974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.998293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.998611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.998950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.999261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.999568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:25.999875 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.000181 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.000487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.000793 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.001097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.001415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.001727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.002044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.002350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.002675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.003089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.003341 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.003648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.003987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.004306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.004622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.004941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.005257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.005565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.005871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.006176 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.006495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.006850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.007159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.007410 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.007711 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.008015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.008333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.008642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.008949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.009257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.009560 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.009866 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.010173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.010478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.011353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.011666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.011971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.012275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.012582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.012885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.013203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.013700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.014016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.014323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.014818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.015135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.015842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.015842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.016062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.016404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.016693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.016998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.017318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.017626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.017934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.018251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.018552 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.018884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.019211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.019514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.019832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.020120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.020421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.020726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.021030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.021331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.021641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.021939 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.022257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.022564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.022895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.023204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.023509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.023828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.024163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.024499 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.024844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.025159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.025494 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.025826 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.025967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:52:26.026444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.026583 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:52:26.026719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.026890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:52:26.027031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.027168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:52:26.027305 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.027434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:52:26.027570 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.027712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.027847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.028016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.028156 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.028336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.028475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.028654 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.028791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.028981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.029122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.029288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.029424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.029604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.029761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.029921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.030077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.030214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.030354 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.030494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.030628 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.030819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.030953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.031133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850697-1-iscsi {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.031281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.031456 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.031588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.031759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.031890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.032069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.032213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.032387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.032526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.032689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.032823 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.033011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.033144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.033315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.033447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.033668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.033807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.033964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.034102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.034290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.034429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.034631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.034817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.034961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.035098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.035278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.035417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.035590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.035731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.035905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.036044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.036217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.036356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.036527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.036671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.036832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.036963 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.037168 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.037299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850697-1-iscsi {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.037482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.037621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.037797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.037936 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.038110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.038248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.038428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.038567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.038740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.038968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.039105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.039241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.039384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.039522 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.039658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.039786 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.039958 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.040106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.040264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.040403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.040575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.040707 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.040878 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.041029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.041198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.041330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.041525 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.041657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.041829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.042474 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.042650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.042809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.042992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.043132 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.043297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.043431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.043600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.043739 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.043868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.044003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.044140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.044278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.044444 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.044575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.044760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.044898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.045080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.045225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.045362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.045499 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.045627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.045765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.045886 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.046020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.046155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.046284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.046464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.046609 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.046783 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.046918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.047093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.047226 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.047398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.047594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.047725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.047860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.047987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.048122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.048286 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.048418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.048591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.048723 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.048906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.049045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.049219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.049352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.049538 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.049671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.049844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.049983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.050161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.050300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.050554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.050686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.050859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.050989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.051129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.051258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.051442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.051587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.051759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.051905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.052067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.052209 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.052377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.052515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.052684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.052817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.052988 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.053127 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.053292 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.053429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.053593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.053732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.053896 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.054028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.054199 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.054330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.054509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.054640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.054798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.054927 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.055065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.055201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.055337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.055472 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.055657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.055789 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.055969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.056100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.056276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.056408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.056581 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.056724 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.056878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.057017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.057183 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.057327 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.057507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.058146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.058409 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.058529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.058743 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.058903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.059088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.059214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.059394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.059523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.059702 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.059830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.060008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.060135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.060315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.060468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.060631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.060778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.060943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.061083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.061247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.061377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.061552 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.061694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.061857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.061997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.062162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.062304 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.062481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.062618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.062812 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.062960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.063098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.063236 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.063417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.063549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.063723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.063868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.064026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.064158 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.064341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.064484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.064645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.064786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.064950 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.065082 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.065266 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.065399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.065563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.065709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.065867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.065999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.066176 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.066307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.066480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.066618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.066792 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.066937 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.067104 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.067237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.067406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.067539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.067708 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.067846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.068009 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.068151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.068309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.068450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.068609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.068749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.068905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.069046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.069221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.069354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.069525 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.069657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.069831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.070543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.070691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.070961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.070961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.071209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.071345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.071488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:52:26.071626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.071760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.071889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072280 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072673 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.072945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073859 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.073997 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074133 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074532 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.074895 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.075972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076370 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.076890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.077870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.078867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079810 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.079944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080119 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080426 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.080870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081810 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.081981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082293 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.082923 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083233 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083545 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.083986 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.084921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.085979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.086942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.087874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088645 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.088862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089167 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089307 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089476 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089609 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089781 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.089912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.090877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091427 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091715 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.091987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.092941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093417 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.093867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.094810 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.095238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.095372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.095544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.095676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.095887 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096192 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.096988 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.097206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.097332 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.097513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.097714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.097840 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.098800 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.104290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.104961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105415 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105787 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105878 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.105968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106145 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106228 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106385 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106645 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.106981 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107152 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107241 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.107920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108692 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.108948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109117 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.109927 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110102 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110729 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.110965 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111228 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.111956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112378 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112824 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.112950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113560 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.113858 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114009 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.114871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.115799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.116971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117586 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.117942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118553 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.118986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.119906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.120644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.120763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.120954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.121881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122640 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.122982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.123896 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124368 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124813 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.124991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.125902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126359 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126625 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.126958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127149 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127457 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.127902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128680 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.128990 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129474 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129646 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.129959 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.130917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131673 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.131975 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132771 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.132903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133792 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.133983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134622 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.134968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135748 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.135928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136248 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.136915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137341 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137528 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.137968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.138146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.138265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.138452 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.138579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.138759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141724 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141814 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.141904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142630 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.142931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143021 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143285 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.143923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144088 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144260 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144352 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144859 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.144950 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145781 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.145871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146614 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146744 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.146929 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147075 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.147982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.148897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149652 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.149955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150729 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.150892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151057 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151532 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151833 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.151996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.152977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153531 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.153935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.154889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.155833 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.156920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157050 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.157870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.158959 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159245 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159721 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.159860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160157 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160624 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.160922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.161979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162457 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.162923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.163874 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164058 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164541 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.164815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165472 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.165949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.166087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.166252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.166392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.166568 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.166700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.167490 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.167634 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.167752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.167955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168099 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168413 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.168902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.169879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170191 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170492 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.170957 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171750 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.171890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172059 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172368 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.172991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173610 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.173914 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.174860 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175182 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175490 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175792 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.175938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.176846 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177463 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.177963 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178743 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.178943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179568 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.179870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.180904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.181936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.182116 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.182257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.182440 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183380 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.183978 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184303 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.184920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185050 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.185990 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.186320 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.186450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.186636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.186830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.186961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.187941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188581 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.188901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189526 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.189824 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.190955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191270 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191398 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191563 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191693 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.191876 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192182 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.192955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.193881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.194980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195110 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.195912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.196958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197269 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.197944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.198906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.199846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.200946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201837 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.201977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202308 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202826 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.202971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203137 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203443 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.203879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204208 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.204983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205287 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205800 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.205932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206596 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.206910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207398 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207529 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.207829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.208922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209369 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.209867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210483 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210808 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.210956 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211437 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.211899 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.212828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213153 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.213989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214433 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.214956 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215610 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.215952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.216897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217525 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.217830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.218966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.219117 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.219275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.219414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.219628 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.219775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220354 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.220892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221457 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.221924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222228 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.222870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.223882 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224051 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224795 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.224984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225126 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225634 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225768 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.225946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.226905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227226 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.227982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.228160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.228367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.228508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.228683 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.228817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.229017 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.229162 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.229844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.229990 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.230977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231156 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.231903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232389 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232694 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.232826 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.233952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.234967 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235778 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.235910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236247 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236423 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.236870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237812 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.237982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238293 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.238928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239553 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.239991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.240169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.240303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.240474 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.240616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.240753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:52:26.240888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.241095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.241395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.241700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.242011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.242317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.242621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.242951 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.243257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.243572 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.243875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.244184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.244489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.244802 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.245668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.246016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.246377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.246715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.247049 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.247355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.247678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.247991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.248315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.248631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.248941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.249299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.249618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.250216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.250554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.250915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.251264 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.251601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.251914 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.252221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.252527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.252855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.253168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.253480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.253791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.254122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.254418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.254728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.255071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.255380 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.255688 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.255998 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.256307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.256621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.256931 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.257251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.257604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.257925 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.258246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.258562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.258902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.259217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.259527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.259837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.260144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.260460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.260829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.261147 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.261451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.261887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.262200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.262519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.262869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.263185 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.263508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.263831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.264143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.264463 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.264777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.265108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.265449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.265776 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.266102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.266406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.266713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.268077 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.268392 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.268731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.269056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.269370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.269681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.270001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.270313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.270624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.270960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.271272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.271585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.271893 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.272201 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.272506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.272814 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.273123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.273425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.273736 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.274040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.274345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.274649 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.274996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.275302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.275647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.275982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.276341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.276792 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.277366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.277962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.278527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.279146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.279755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.280367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.280938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.281557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.282153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.282762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.283247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.283576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.283899 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.284223 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.284570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.284905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286899 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.286899 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.287177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.287477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.287794 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.288111 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.288493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.288739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.289062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.289379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.289698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.290022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.290345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.290682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.292395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.292395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.292395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.292804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.292944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.294699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.294699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.294699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.294699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.294699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.295405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:52:26.295405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:52:26.393144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO dbcounter [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Registered counter for database nova_api Jul 21 22:52:26.413566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_db.sqlalchemy.engines [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.420094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writer thread running {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.447458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO dbcounter [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Registered counter for database nova_api Jul 21 22:52:26.467774 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_db.sqlalchemy.engines [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.474894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writer thread running {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.476968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.context [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efb1614c-6e53-4961-af0f-ea703c25657e(cell1) {{(pid=124925) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:52:26.481146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.482747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.483594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.485597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.487635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO dbcounter [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Registered counter for database nova_cell0 Jul 21 22:52:26.491913 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO dbcounter [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Registered counter for database nova_cell1 Jul 21 22:52:26.500480 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_db.sqlalchemy.engines [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.501757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_db.sqlalchemy.engines [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.508443 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writer thread running {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.509706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writer thread running {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.531837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.context [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efb1614c-6e53-4961-af0f-ea703c25657e(cell1) {{(pid=124924) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:52:26.535915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.537506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.538318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.540331 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.542336 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO dbcounter [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Registered counter for database nova_cell0 Jul 21 22:52:26.546344 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO dbcounter [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Registered counter for database nova_cell1 Jul 21 22:52:26.553657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_db.sqlalchemy.engines [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.556587 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_db.sqlalchemy.engines [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.564567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writer thread running {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.565834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writer thread running {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.653560 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO dbcounter [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Registered counter for database nova_cell0 Jul 21 22:52:26.661131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_db.sqlalchemy.engines [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.666527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writer thread running {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:26.714295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO dbcounter [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Registered counter for database nova_cell0 Jul 21 22:52:26.721316 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_db.sqlalchemy.engines [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:52:26.725916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writer thread running {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:52:27.001471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: WARNING keystonemiddleware.auth_token [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:52:27.008797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: WARNING keystonemiddleware.auth_token [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:52:27.049872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: WARNING keystonemiddleware.auth_token [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:52:27.057236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: WARNING keystonemiddleware.auth_token [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:52:27.355438 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: WARNING keystonemiddleware.auth_token [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:52:27.361503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: WARNING keystonemiddleware.auth_token [None req-07de8b60-8c0e-49d0-a706-d04ce42cf2f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:52:27.367747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55710b7789c0 pid: 124925 (default app) Jul 21 22:52:27.403760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: WARNING keystonemiddleware.auth_token [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:52:27.409820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: WARNING keystonemiddleware.auth_token [None req-584338f1-987e-42e8-bfb2-f57d591f57f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:52:27.415901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55710b7789c0 pid: 124924 (default app) Jul 21 22:53:09.632583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:09.633960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:09.634918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:09.635659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:10.579077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c56e4ea1-3c2a-497f-9fdd-c8606b119b6b tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Action: 'create', calling method: .version_select at 0x7fc5e5c31ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-453580960"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:12.261450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c56e4ea1-3c2a-497f-9fdd-c8606b119b6b tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.640786 Jul 21 22:53:12.262354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1154 bytes} [Thu Jul 21 22:53:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2643 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 21 22:53:12.278274 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:12.279917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:12.281012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:12.283812 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:12.608343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0ad5483c-50fe-46cb-91de-36df4589d10c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5c81940>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:13.046357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0ad5483c-50fe-46cb-91de-36df4589d10c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 200 len: 344 microversion: 2.1 time: 0.773835 Jul 21 22:53:13.046357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 22:53:12 2022] GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 344 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:14.062105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-97dc9421-3941-46b8-8164-b892c61f8e26 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5afeaf0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:14.408206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-97dc9421-3941-46b8-8164-b892c61f8e26 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 200 len: 345 microversion: 2.1 time: 0.350967 Jul 21 22:53:14.409446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 22:53:14 2022] GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 345 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:14.427102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e9f7dd40-71bb-4de4-bd9c-79eda54d3478 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Action: 'create', calling method: .version_select at 0x7fc5e5b46d30>, body: {"snapshot": {"volume_id": "90016172-b2f5-45d4-82da-0897b4db2b7d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-353201160"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:15.699502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e9f7dd40-71bb-4de4-bd9c-79eda54d3478 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.276940 Jul 21 22:53:15.701834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 2/4] 10.222.0.52 () {60 vars in 1161 bytes} [Thu Jul 21 22:53:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:15.713340 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-27da1b8d-5783-40e0-8999-5f4ca1f633f3 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5afec10>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:15.751442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-27da1b8d-5783-40e0-8999-5f4ca1f633f3 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.042933 Jul 21 22:53:15.752342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:15 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:15.762464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6d9c51dc-7b3b-4291-aaaa-5e68ecfe553e tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b46a60>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:15.825381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6d9c51dc-7b3b-4291-aaaa-5e68ecfe553e tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.066645 Jul 21 22:53:15.825952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jul 21 22:53:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:15.845039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1f8f4546-2974-401d-8f3a-ff11439c170c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b1b310>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:16.059765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1f8f4546-2974-401d-8f3a-ff11439c170c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.226857 Jul 21 22:53:16.062372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:15 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:17.075073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a7d8d550-2e27-42ed-8bba-1f18b9c12033 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5aff790>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:17.154083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a7d8d550-2e27-42ed-8bba-1f18b9c12033 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.085244 Jul 21 22:53:17.160011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:17 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:18.170597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-512b3ef8-abfb-4f88-aa41-589f79cb2bc3 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b1b9d0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:18.230752 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-512b3ef8-abfb-4f88-aa41-589f79cb2bc3 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.064180 Jul 21 22:53:18.232424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:18 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:19.244502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-66e47b43-abea-4dea-bb7d-e18086052417 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5affee0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:19.300108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-66e47b43-abea-4dea-bb7d-e18086052417 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.060326 Jul 21 22:53:19.301130 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:19 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:20.313587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-618a9643-50c6-4c2d-87d2-ca8b574a5119 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b1baf0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:20.365937 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-618a9643-50c6-4c2d-87d2-ca8b574a5119 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 287 microversion: 2.1 time: 0.058093 Jul 21 22:53:20.366696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:20 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:20.376902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-716a3f48-2018-4fc2-bdaa-19994c945e8d tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5affd30>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:20.568004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-716a3f48-2018-4fc2-bdaa-19994c945e8d tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 202 len: 0 microversion: 2.1 time: 0.194982 Jul 21 22:53:20.569404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1253 bytes} [Thu Jul 21 22:53:20 2022] DELETE /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:53:20.577701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-064216ed-728c-4862-a387-5695ba740e39 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b1b550>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:20.617358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-064216ed-728c-4862-a387-5695ba740e39 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.042773 Jul 21 22:53:20.618466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:20 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:20.934806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-227630949", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "networks": [{"uuid": "890d251b-f2ed-45b8-839e-e822b200a30c"}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:21.079585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] validate_networks() for [('890d251b-f2ed-45b8-839e-e822b200a30c', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:53:21.629749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0d585d62-832c-4d58-8ab0-d54d96ddc245 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5afe9d0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:21.697469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0d585d62-832c-4d58-8ab0-d54d96ddc245 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.072128 Jul 21 22:53:21.698528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:21 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:22.713696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-19eaccc5-a0da-47b2-af66-9e62c3940559 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b24160>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:22.793795 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-19eaccc5-a0da-47b2-af66-9e62c3940559 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 200 len: 286 microversion: 2.1 time: 0.088238 Jul 21 22:53:22.794589 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 9/15] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:22 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:53:23.806652 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-83e174d8-d7a1-40e9-9859-ddaf2d5b993a tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5afed30>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:23.898101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-83e174d8-d7a1-40e9-9859-ddaf2d5b993a tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] HTTP exception thrown: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-83e174d8-d7a1-40e9-9859-ddaf2d5b993a tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Request method failure captured: Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d HTTP/1.1 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djV4nZIndAhz0KR-POzufqLHtHtj0bdiCH7-fY-3lWwCVIuGPMDpqcdH95DhwloxEnJiU49jEzDkzyrFP25IjtpbiyOrJo8hLKF1EdUZW-bWfo7G6YPT5to6o03uwSUpdGgfGPy6du_BZr89UcT57nrxyvjgSrHYwSq5pRN1U-UPIg Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:53:23.902490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ee94dac76504026acfa65efdce67cd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: b770572014374cfca1053bc07259a30e Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'bf9a884a-16e4-45fd-b472-11eaa29e347d'} Jul 21 22:53:23.903986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. (HTTP 404) (Request-ID: req-858a4874-c610-4f96-b2b4-71572635f6f9) Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.904819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:23.905954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 22:53:23.907112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-83e174d8-d7a1-40e9-9859-ddaf2d5b993a tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Returning 404 to user: Snapshot bf9a884a-16e4-45fd-b472-11eaa29e347d could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:53:23.908264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-83e174d8-d7a1-40e9-9859-ddaf2d5b993a tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d" status: 404 len: 111 microversion: 2.1 time: 0.102413 Jul 21 22:53:23.909126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 22:53:23 2022] GET /compute/v2.1/os-snapshots/bf9a884a-16e4-45fd-b472-11eaa29e347d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:53:23.925742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-24f0491c-9516-4ff7-adb1-9f6e01b0871e tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e64940d0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:24.018662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:53:24.019955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:53:24.020802 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:53:24.021329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:53:24.021903 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:53:24.102123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:24.113438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:24.118636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:24.119816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:24.277519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Getting quotas for project ba0db0569e094eccb3e8fc578a16fc1e. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:24.291681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-24f0491c-9516-4ff7-adb1-9f6e01b0871e tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 202 len: 0 microversion: 2.1 time: 0.382399 Jul 21 22:53:24.292523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 11/17] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:53:23 2022] DELETE /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:53:24.301359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2f9d0f4f-4a16-4e3c-a1ee-c65129ac3284 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5b245e0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:24.319727 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Getting quotas for user ca0902f6348840729a6ce7a97167da9c and project ba0db0569e094eccb3e8fc578a16fc1e. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:24.356961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:53:24.365973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:53:24.546167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2f9d0f4f-4a16-4e3c-a1ee-c65129ac3284 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 200 len: 344 microversion: 2.1 time: 0.244985 Jul 21 22:53:24.546167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 12/18] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 22:53:24 2022] GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 344 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:24.684884 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f75f453f-fa44-4911-a8ed-5f0edc51659e tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.944276 Jul 21 22:53:24.686330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 7/19] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:53:24.700394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e527ab65-1587-4dc9-8ceb-7febd313a12a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:24.701238 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e527ab65-1587-4dc9-8ceb-7febd313a12a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:25.044750 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e527ab65-1587-4dc9-8ceb-7febd313a12a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:25.073013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e527ab65-1587-4dc9-8ceb-7febd313a12a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1214 microversion: 2.1 time: 0.380498 Jul 21 22:53:25.078134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 8/20] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:24 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:25.287243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9feb5c4a-92f6-41db-8bc0-52dc0423e551 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: .version_select at 0x7fc5e5b24c10>, body: {"keypair": {"name": "tempest-keypair-2135871868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD98PxnuTNLSQD6AU0gJeoSNTvSbmtha13edKGpxWRWeIcyaDXhyvw0K44oMms5brHR0y6mI/MIg25Lvuf7kFJo7fXIkNhHk3aBmdhVkdMcOEp/HVi0OxK2cn/CBi6XuXQ=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:25.428753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-9feb5c4a-92f6-41db-8bc0-52dc0423e551 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for project 2f7e8103418741398872d59d16e0e919. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:25.436009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-9feb5c4a-92f6-41db-8bc0-52dc0423e551 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for user d10c68b7fd4446feb759832913fea3b3 and project 2f7e8103418741398872d59d16e0e919. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:25.556828 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb5307c8-ac6a-48c4-993a-11afee66111c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5a139d0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:25.582701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9feb5c4a-92f6-41db-8bc0-52dc0423e551 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.925511 Jul 21 22:53:25.582701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 13/21] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jul 21 22:53:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 928 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 22:53:25.615483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-cb5307c8-ac6a-48c4-993a-11afee66111c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] HTTP exception thrown: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb5307c8-ac6a-48c4-993a-11afee66111c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Request method failure captured: Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d HTTP/1.1 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djV4nZIndAhz0KR-POzufqLHtHtj0bdiCH7-fY-3lWwCVIuGPMDpqcdH95DhwloxEnJiU49jEzDkzyrFP25IjtpbiyOrJo8hLKF1EdUZW-bWfo7G6YPT5to6o03uwSUpdGgfGPy6du_BZr89UcT57nrxyvjgSrHYwSq5pRN1U-UPIg Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:53:25.634225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ee94dac76504026acfa65efdce67cd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: b770572014374cfca1053bc07259a30e Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '90016172-b2f5-45d4-82da-0897b4db2b7d'} Jul 21 22:53:25.635930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. (HTTP 404) (Request-ID: req-fbe63fc5-b1a3-44b5-acdb-d521e7b05f7f) Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.636701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:25.637772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:53:25.638692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.640667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.644093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb5307c8-ac6a-48c4-993a-11afee66111c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Returning 404 to user: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:53:25.645042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cb5307c8-ac6a-48c4-993a-11afee66111c tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 404 len: 109 microversion: 2.1 time: 0.092731 Jul 21 22:53:25.667924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5ba626ae-a9b3-4ecd-b5e2-0b57e6c05a4f tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5a3fb80>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:25.672398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 9/22] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 22:53:25 2022] GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:53:25.720149 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-5ba626ae-a9b3-4ecd-b5e2-0b57e6c05a4f tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] HTTP exception thrown: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5ba626ae-a9b3-4ecd-b5e2-0b57e6c05a4f tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Request method failure captured: Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d HTTP/1.1 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djV4nZIndAhz0KR-POzufqLHtHtj0bdiCH7-fY-3lWwCVIuGPMDpqcdH95DhwloxEnJiU49jEzDkzyrFP25IjtpbiyOrJo8hLKF1EdUZW-bWfo7G6YPT5to6o03uwSUpdGgfGPy6du_BZr89UcT57nrxyvjgSrHYwSq5pRN1U-UPIg Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:53:25.722536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ee94dac76504026acfa65efdce67cd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: b770572014374cfca1053bc07259a30e Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '90016172-b2f5-45d4-82da-0897b4db2b7d'} Jul 21 22:53:25.723638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. (HTTP 404) (Request-ID: req-d0f5d3c1-bfaa-4cb7-a304-fc410f097b5d) Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.724256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:53:25.725200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:53:25.726224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.727256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.729345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5ba626ae-a9b3-4ecd-b5e2-0b57e6c05a4f tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Returning 404 to user: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:53:25.731904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5ba626ae-a9b3-4ecd-b5e2-0b57e6c05a4f tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 404 len: 109 microversion: 2.1 time: 0.072734 Jul 21 22:53:25.738597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 14/23] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:53:25 2022] DELETE /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:53:25.758030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65b814c5-0529-4df9-8df4-cf1dd77e4ed8 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Calling method '.version_select at 0x7fc5e5201790>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:25.821972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-65b814c5-0529-4df9-8df4-cf1dd77e4ed8 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] HTTP exception thrown: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65b814c5-0529-4df9-8df4-cf1dd77e4ed8 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Request method failure captured: Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d HTTP/1.1 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djV4nZIndAhz0KR-POzufqLHtHtj0bdiCH7-fY-3lWwCVIuGPMDpqcdH95DhwloxEnJiU49jEzDkzyrFP25IjtpbiyOrJo8hLKF1EdUZW-bWfo7G6YPT5to6o03uwSUpdGgfGPy6du_BZr89UcT57nrxyvjgSrHYwSq5pRN1U-UPIg Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:53:25.824316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7ee94dac76504026acfa65efdce67cd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7ee94dac76504026acfa65efdce67cd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7ee94dac76504026acfa65efdce67cd5 Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1586262422 Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: b770572014374cfca1053bc07259a30e Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1586262422-project Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '90016172-b2f5-45d4-82da-0897b4db2b7d'} Jul 21 22:53:25.825356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. (HTTP 404) (Request-ID: req-9d7fafc5-7796-4192-868c-7e4974905888) Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.826094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:53:25.827018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:53:25.827980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65b814c5-0529-4df9-8df4-cf1dd77e4ed8 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] Returning 404 to user: Volume 90016172-b2f5-45d4-82da-0897b4db2b7d could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:53:25.828852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-65b814c5-0529-4df9-8df4-cf1dd77e4ed8 tempest-VolumesSnapshotsTestJSON-1586262422 tempest-VolumesSnapshotsTestJSON-1586262422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d" status: 404 len: 109 microversion: 2.1 time: 0.085985 Jul 21 22:53:25.830835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 15/24] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 22:53:25 2022] GET /compute/v2.1/os-volumes/90016172-b2f5-45d4-82da-0897b4db2b7d => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:53:25.900491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-973271571", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:26.028702 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] validate_networks() for [('418e802f-29ea-4a0c-b0db-8f680811e4d1', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:53:26.098268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-acb2b249-7e0f-4d6f-a2d7-04c67f6961ef tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:26.099126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-acb2b249-7e0f-4d6f-a2d7-04c67f6961ef tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:26.413321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-acb2b249-7e0f-4d6f-a2d7-04c67f6961ef tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:26.445603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-acb2b249-7e0f-4d6f-a2d7-04c67f6961ef tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1214 microversion: 2.1 time: 0.354014 Jul 21 22:53:26.454113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 16/25] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:26 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:27.475165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5b09062a-95b9-4c48-9fc6-c027924ac80d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:27.477465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5b09062a-95b9-4c48-9fc6-c027924ac80d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:27.590219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5b09062a-95b9-4c48-9fc6-c027924ac80d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:27.630666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:53:27.631179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:53:27.631597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:53:27.633069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:53:27.634736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5b09062a-95b9-4c48-9fc6-c027924ac80d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1214 microversion: 2.1 time: 0.167160 Jul 21 22:53:27.636158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:53:27.637434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 17/26] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:27 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:27.679442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:27.679888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:27.680687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:27.682527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:27.743829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:27.750094 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for user 4947466838974a71815561640fa55c14 and project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:27.784938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:53:27.791596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:53:28.017221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7ff8d5a7-43d8-4b2d-8529-d4069fb7a473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.306286 Jul 21 22:53:28.036875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 10/27] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:53:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:53:28.041832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-de11f88c-5900-47c9-b420-ad8100a1bab2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:28.042451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-de11f88c-5900-47c9-b420-ad8100a1bab2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:28.249840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-de11f88c-5900-47c9-b420-ad8100a1bab2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:28.260968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-de11f88c-5900-47c9-b420-ad8100a1bab2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1221 microversion: 2.1 time: 0.222941 Jul 21 22:53:28.262225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 11/28] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:28 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1221 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:28.656263 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a7704332-e605-4929-bf7c-65774e40ca9d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:28.657799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a7704332-e605-4929-bf7c-65774e40ca9d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:28.696945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c5bc9687-1ee7-4cdc-b796-b065d0b60f5c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: .version_select at 0x7fc5e51d6040>, body: {"keypair": {"name": "tempest-keypair-2004366987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUSKVsT2iiVGkiYODgvBuDVUhHEQm1cXnmtecGuo/wyxXLT05bhr1o0O5Dhmp++8Wo/FZWvfvPEi7CHDM76dfkHfC2bY6kL+00Hioge/OnmssrHdi5lIsiVExmE8enw/Q=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:28.734418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-c5bc9687-1ee7-4cdc-b796-b065d0b60f5c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for project 08576395a1f1437385d2f24b482572a6. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:28.759867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a7704332-e605-4929-bf7c-65774e40ca9d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:28.767797 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a7704332-e605-4929-bf7c-65774e40ca9d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1214 microversion: 2.1 time: 0.114725 Jul 21 22:53:28.770046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 12/29] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:28 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:28.804793 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-c5bc9687-1ee7-4cdc-b796-b065d0b60f5c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for user ef9ff560b7044ea2a18b3c3f8295937e and project 08576395a1f1437385d2f24b482572a6. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:28.814075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-532086043", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:28.924035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] validate_networks() for [('418e802f-29ea-4a0c-b0db-8f680811e4d1', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:53:28.979239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c5bc9687-1ee7-4cdc-b796-b065d0b60f5c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.976726 Jul 21 22:53:28.980353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 18/30] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:53:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:53:29.796522 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:29.797279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:29.808008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:29.808872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:29.809905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:29.810660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:30.301211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:30.324788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7de0e3f2-f371-420a-84e6-75dd5093644b tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1210 microversion: 2.1 time: 0.538342 Jul 21 22:53:30.328073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:29 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1210 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:30.979595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:53:30.980545 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:53:30.981160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:53:30.981739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:53:30.982381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:53:30.998390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.000422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.001492 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.002497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.040045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:31.044116 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for user 4947466838974a71815561640fa55c14 and project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:31.056793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:53:31.059141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:53:31.217938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-066dfd73-51d2-488f-bb45-9ecf87912b9a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.409916 Jul 21 22:53:31.219082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 13/32] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:53:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:53:31.233045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-450ea0f4-c7cd-463d-9eac-e949665bf7c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:31.233665 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-450ea0f4-c7cd-463d-9eac-e949665bf7c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:31.346245 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:31.347208 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:31.359237 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.360618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.362023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.365657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.570089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-450ea0f4-c7cd-463d-9eac-e949665bf7c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:31.583806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-450ea0f4-c7cd-463d-9eac-e949665bf7c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1221 microversion: 2.1 time: 0.355780 Jul 21 22:53:31.587395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 20/33] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:31 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:31.830092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:31.861958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6b37cd60-690c-4f88-8074-9ce51e9b5ce8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1274 microversion: 2.1 time: 0.518469 Jul 21 22:53:31.876719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 14/34] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:31 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1274 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:32.603608 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-76d9fc76-cd23-4195-8cf0-033316d113cc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:32.604227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-76d9fc76-cd23-4195-8cf0-033316d113cc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:32.783155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1936401043", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9aabd78e-e211-4aea-bb01-9d58894470ca"}], "security_groups": [{"name": "tempest-securitygroup--706487807"}], "key_name": "tempest-keypair-2135871868", "user_data": "}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:32.953431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-76d9fc76-cd23-4195-8cf0-033316d113cc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:32.970057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-76d9fc76-cd23-4195-8cf0-033316d113cc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1221 microversion: 2.1 time: 0.363971 Jul 21 22:53:32.970962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 21/35] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:32 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1221 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:33.009225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:33.010210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:33.037021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:33.040492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:33.042660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:33.044177 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:33.336853 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:33.357349 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3a6e5894-fb21-422d-a6fd-0a6ce80feb06 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1272 microversion: 2.1 time: 0.382709 Jul 21 22:53:33.358596 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 22/36] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:32 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:33.497458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] validate_networks() for [('9aabd78e-e211-4aea-bb01-9d58894470ca', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:53:33.987242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:33.988074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:34.005062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.007747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:34.010225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.011294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:34.841531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:34.859898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-edb64e37-b9f1-4a6c-93aa-9f4ed660509d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1273 microversion: 2.1 time: 0.876355 Jul 21 22:53:34.863322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 23/37] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:33 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1273 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:34.885233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:34.889417 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:34.910174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.910639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:34.922035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.922035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:35.261024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:35.280553 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-17d1711b-f976-4fff-b713-0cf7b05d3be3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1272 microversion: 2.1 time: 0.415466 Jul 21 22:53:35.295478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 24/38] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:34 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1272 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:35.887025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:35.887025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:35.966586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:35.966586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:35.966586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:35.966586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:36.312985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:36.312985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6807cbda-b9f9-442c-b9a1-bfc53b933a9e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1279 microversion: 2.1 time: 0.425121 Jul 21 22:53:36.312985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 25/39] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:35 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1279 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:36.341747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:36.342599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:36.358611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:36.359392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:36.361108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:36.361835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:37.069870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:53:37.074253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:53:37.074253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:53:37.074253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:53:37.074253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:53:37.096235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.097506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:37.102035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.102535 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:37.129861 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:37.140191 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-59565a87-ee28-4840-8b3e-f4618349135f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.831087 Jul 21 22:53:37.150489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 26/40] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:36 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:37.159339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2031583903", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "886605d9-b2c5-42f8-a453-66f8a90cc2d9"}], "security_groups": [{"name": "tempest-securitygroup--217310823"}], "key_name": "tempest-keypair-2004366987", "user_data": "}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:37.193842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for project 2f7e8103418741398872d59d16e0e919. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:37.215410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for user d10c68b7fd4446feb759832913fea3b3 and project 2f7e8103418741398872d59d16e0e919. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:37.293861 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:53:37.313112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:53:37.590783 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ebf462ee-338c-4693-8128-4048ca75ab69 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.819355 Jul 21 22:53:37.591466 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 15/41] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jul 21 22:53:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 4822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 22:53:37.602070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:37.607498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:37.646805 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.654263 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:37.655430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.655904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:38.198278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] validate_networks() for [('886605d9-b2c5-42f8-a453-66f8a90cc2d9', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:53:39.079365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.100388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4a29d9fd-e5ca-4b3e-9dd7-d3be7a7909ec tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 1.493412 Jul 21 22:53:39.100388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 16/42] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:37 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:39.103948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:39.105123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:39.255167 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.269139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.291381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.293919 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-06e58b99-3e4d-41ec-8502-4c135727d0f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1282 microversion: 2.20 time: 0.203008 Jul 21 22:53:39.295603 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 17/43] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:39 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:39.316045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:39.316901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:39.337865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:39.338555 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:39.342100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:39.342100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:39.830410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.838564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-005f419f-ec61-4fc4-b298-3359beffce4f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.541724 Jul 21 22:53:39.839185 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 18/44] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:39 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:40.106514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:40.107109 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:40.124372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.125592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.128073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.129408 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.606489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.618918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9e604c39-e67d-4640-a529-c47bf3e05f0c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.515874 Jul 21 22:53:40.623851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 19/45] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:40 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:40.632189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:40.635524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:40.651542 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.655414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.656507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.657103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.751771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:53:40.752296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:53:40.752803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:53:40.753222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:53:40.753634 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:53:40.783369 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.784688 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.786568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.789376 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.854982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.854982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.859157 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.863677 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-65c5a145-1f07-4660-95ba-47ec14b814d6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1334 microversion: 2.20 time: 0.238837 Jul 21 22:53:40.865683 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 20/46] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:40 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1334 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:40.870435 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:40.877138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:40.894042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.895525 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.903085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.904530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.932076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for project 08576395a1f1437385d2f24b482572a6. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:53:40.944397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for user ef9ff560b7044ea2a18b3c3f8295937e and project 08576395a1f1437385d2f24b482572a6. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:53:40.984814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:53:40.994503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:53:41.647363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-32a9429f-3d08-4b50-8bf5-479268fe243f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.481453 Jul 21 22:53:41.648300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 27/47] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:53:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 4501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:53:41.828373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-ec19cc5f-2cb5-45e7-a9f6-4895e116a67f req-9c888310-10b0-4b0b-93de-30c021b0806c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8", "tag": "43693aff-eb0b-4fa8-90d5-a5e82416c624"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:41.863421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-ec19cc5f-2cb5-45e7-a9f6-4895e116a67f req-9c888310-10b0-4b0b-93de-30c021b0806c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:41.868163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:41.868680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-ec19cc5f-2cb5-45e7-a9f6-4895e116a67f req-9c888310-10b0-4b0b-93de-30c021b0806c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:41.874422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-730dcbfe-b03f-4d53-856d-f0977fc6b77f tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 1.007351 Jul 21 22:53:41.891534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 21/48] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:40 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:41.916946 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-ec19cc5f-2cb5-45e7-a9f6-4895e116a67f req-9c888310-10b0-4b0b-93de-30c021b0806c service nova] Creating event network-changed:43693aff-eb0b-4fa8-90d5-a5e82416c624 for instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 on hv-cinder-85069 Jul 21 22:53:41.922125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-ec19cc5f-2cb5-45e7-a9f6-4895e116a67f req-9c888310-10b0-4b0b-93de-30c021b0806c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124925) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:53:41.923607 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:41.926151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:41.929912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:41.931700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:41.981285 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.compute.rpcapi [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:53:41.983835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] Releasing lock "compute-rpcapi-router" {{(pid=124925) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:53:42.025977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d839d83-f0e6-43f1-97e6-314d88889717 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371280 Jul 21 22:53:42.050523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 28/49] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:42.058546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:42.063836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:42.091649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.091649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.100447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.101007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.129307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-4a6fff56-0c7d-4d78-a62b-d127d89f501b req-04e88894-8e9e-4fba-b748-13c99484bcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f21ad4b-325d-4945-91ee-58ed919e892c", "tag": "2b3bc926-e36a-4b2b-a85a-0356b93dec8b"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:42.154355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-4a6fff56-0c7d-4d78-a62b-d127d89f501b req-04e88894-8e9e-4fba-b748-13c99484bcbb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.154911 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-4a6fff56-0c7d-4d78-a62b-d127d89f501b req-04e88894-8e9e-4fba-b748-13c99484bcbb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.201269 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-4a6fff56-0c7d-4d78-a62b-d127d89f501b req-04e88894-8e9e-4fba-b748-13c99484bcbb service nova] Creating event network-changed:2b3bc926-e36a-4b2b-a85a-0356b93dec8b for instance 0f21ad4b-325d-4945-91ee-58ed919e892c on hv-cinder-85069 Jul 21 22:53:42.202194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-4a6fff56-0c7d-4d78-a62b-d127d89f501b req-04e88894-8e9e-4fba-b748-13c99484bcbb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:53:42.203632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.207083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.208409 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.209076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.241221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.compute.rpcapi [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:53:42.246132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] Releasing lock "compute-rpcapi-router" {{(pid=124924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:53:42.284751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-51032578-8aa9-4118-885e-0b3f09cd0d0a None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390835 Jul 21 22:53:42.288001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 22/50] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:42.316930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5d3f8b49-24be-4c0a-beb5-0af475bf478d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:42.320719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5d3f8b49-24be-4c0a-beb5-0af475bf478d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:42.341920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:42.729439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5d3f8b49-24be-4c0a-beb5-0af475bf478d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:42.737033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5d3f8b49-24be-4c0a-beb5-0af475bf478d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1238 microversion: 2.1 time: 0.447270 Jul 21 22:53:42.737627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 23/51] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:42 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1238 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:42.753012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:42.753877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:42.775972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:42.776784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.777176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.779439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.779909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.782097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-65eba9af-d489-463a-8abd-01ec205a7deb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.732202 Jul 21 22:53:42.786188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 29/52] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:42 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:42.895964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:42.898359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:42.911467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.913855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.917038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.920829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.169809 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.187588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.190676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.195065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-58c5ac3e-8112-45a4-a8f4-da5d8bd3b6d0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1340 microversion: 2.20 time: 0.445973 Jul 21 22:53:43.207305 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 24/53] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:42 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1340 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:43.325360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.333873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-22bd6bd7-1af3-4861-b519-80de4bb03460 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.442358 Jul 21 22:53:43.336999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:42 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:43.756075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:43.756996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:43.771484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.774334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.777965 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.778593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.804104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:43.804885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:43.812641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.813106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.818464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.819960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.913622 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.926315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-950aec29-261a-471b-8c7b-b4d46c31fd09 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1242 microversion: 2.1 time: 0.174896 Jul 21 22:53:43.932557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 25/55] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:43 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:44.185424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.194126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4a014406-bb7a-4c21-aaa8-613bfa2122f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.395044 Jul 21 22:53:44.195232 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 31/56] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:43 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:44.216334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:44.218748 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:44.226905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.227565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.228533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.229123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.353816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:44.354790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:44.370150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.374490 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.384100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.387281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.640664 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.652400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d38a0a0-1410-40d9-96f0-f2f9168b8f99 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.302707 Jul 21 22:53:44.656566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 32/57] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:44 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:44.668518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-1f85bdc5-bde9-41fb-93ac-ef514e5adbaa req-09d3fe12-f51f-45d9-ac83-eb708b056c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3616f76-15d6-4940-9c44-8cf771d3b170", "tag": "d8513c0b-5706-4b5d-bf3c-154536ce5049"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:44.688383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-1f85bdc5-bde9-41fb-93ac-ef514e5adbaa req-09d3fe12-f51f-45d9-ac83-eb708b056c0c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.688383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-1f85bdc5-bde9-41fb-93ac-ef514e5adbaa req-09d3fe12-f51f-45d9-ac83-eb708b056c0c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.718972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-1f85bdc5-bde9-41fb-93ac-ef514e5adbaa req-09d3fe12-f51f-45d9-ac83-eb708b056c0c service nova] Creating event network-changed:d8513c0b-5706-4b5d-bf3c-154536ce5049 for instance d3616f76-15d6-4940-9c44-8cf771d3b170 on hv-cinder-85069 Jul 21 22:53:44.736098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-1f85bdc5-bde9-41fb-93ac-ef514e5adbaa req-09d3fe12-f51f-45d9-ac83-eb708b056c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078148 Jul 21 22:53:44.736990 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 33/58] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:44.780251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.782500 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=65 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:44.799594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.801231 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.802766 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fbbc7618-5769-4c4b-a10f-0dcfce51733d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.590759 Jul 21 22:53:44.805554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 26/59] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:44 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:44.945091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:44.946718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:44.957132 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.957948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.958745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.959278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.058342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:45.064855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-09f5c756-d946-42ea-95cf-c8d1b096757b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1290 microversion: 2.1 time: 0.124801 Jul 21 22:53:45.067892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 34/60] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:44 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:45.212111 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:45.213007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:45.227051 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.227715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.228601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.229130 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.399957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:45.411355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6a5fa2ce-0c9f-42b9-99fd-9332a4963948 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.203551 Jul 21 22:53:45.423361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 27/61] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:45 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:45.532963 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-d7e90031-be94-49d3-a5cb-588e2e9a020b req-92cc4046-f648-494e-bf8f-dd063c559601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:45.552445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-d7e90031-be94-49d3-a5cb-588e2e9a020b req-92cc4046-f648-494e-bf8f-dd063c559601 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.552915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-d7e90031-be94-49d3-a5cb-588e2e9a020b req-92cc4046-f648-494e-bf8f-dd063c559601 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.579770 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-d7e90031-be94-49d3-a5cb-588e2e9a020b req-92cc4046-f648-494e-bf8f-dd063c559601 service nova] Creating event network-changed:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:53:45.592943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-d7e90031-be94-49d3-a5cb-588e2e9a020b req-92cc4046-f648-494e-bf8f-dd063c559601 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063466 Jul 21 22:53:45.594303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 35/62] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:45.673711 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:45.674514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:45.685184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.686761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.686761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.695107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.833261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:45.835056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:45.866086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.866546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.874651 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.875279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.973157 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.003629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9e3ca4b5-8dcc-49aa-9c0a-4edd8ad0ab58 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.333340 Jul 21 22:53:46.005076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 28/63] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:45 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:46.085589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:46.085777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:46.100733 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.104744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.104744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.104744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.149098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.164050 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.165753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.167478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f809583a-7524-485f-bd1c-79c76717faa8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.341338 Jul 21 22:53:46.170311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 36/64] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:45 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:46.193203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.201367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a14dd80a-b688-4059-a558-a26d905ae412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1290 microversion: 2.1 time: 0.120640 Jul 21 22:53:46.202489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 29/65] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:46 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:46.430057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:46.430674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:46.455509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.455509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.455509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.455509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.620720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.628791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ec69ee39-3af4-4278-ab7d-512acaa5cdeb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.203808 Jul 21 22:53:46.638885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 37/66] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:46 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:47.021935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:47.023296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:47.029860 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.030393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.031262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.031759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.189035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:47.189645 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:47.198855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.199296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.200105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.200541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.231169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.239510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6e17298d-b8a7-4fe7-bad8-70336a12eebe tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.221961 Jul 21 22:53:47.249491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 30/67] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:47 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:47.254977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:47.256388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:47.264552 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.265286 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.266248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.266945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.366300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.382105 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fe3ab6e9-f824-4fa3-91dd-9d3cb2db89de tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1290 microversion: 2.1 time: 0.130924 Jul 21 22:53:47.395253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 31/68] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:47 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1290 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:47.436143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.446301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.449815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.451254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d47fee6e-312d-403d-83ab-f4a65de7723b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.266462 Jul 21 22:53:47.452516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 38/69] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:47 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:47.646835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:47.647703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:47.654124 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.655120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.655907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.656512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.801217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.809497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-594c2979-940f-4bee-889b-e4afa832a564 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.166923 Jul 21 22:53:47.810062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 32/70] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:47 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:48.257293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:48.257894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:48.265618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.271973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.271973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.271973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.399617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:48.400784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:48.407170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.407791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.408550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.408976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.431337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.434759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:48.439451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-44f47351-1100-40fb-a162-7a986412f949 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.186335 Jul 21 22:53:48.440029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 39/71] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:48 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:48.469918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:48.471227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:48.474325 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.485087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-08d1727b-1bd0-43c4-9ecd-4f7851ba2d90 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1290 microversion: 2.1 time: 0.089579 Jul 21 22:53:48.485643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 33/72] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:48 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:48.489529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.490549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.497092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.497764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.693956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.702746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.704531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.705758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2732ca32-8981-44b7-83c0-830719ce1fbf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.240246 Jul 21 22:53:48.716959 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 40/73] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:48 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:48.825299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:48.825935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:48.831987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.832432 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.833204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.833640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.980253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:48.987796 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-89c73db7-6c40-49a5-9bc0-005af78373c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.166330 Jul 21 22:53:48.988376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 34/74] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:48 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:49.457048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:49.457670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:49.463910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.464348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.465099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.465529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.503493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:49.504128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:49.510629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.511146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.512055 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.512487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.634180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.638327 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.650624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9c6c3879-081c-4c07-8349-1a08161f9515 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1290 microversion: 2.1 time: 0.150814 Jul 21 22:53:49.651304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 35/75] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:49 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:49.653219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ed38343c-87dc-4e2a-8eb4-61e7c7f2ea98 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.200527 Jul 21 22:53:49.655077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 41/76] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:49 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:49.729063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:49.729063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:49.732249 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.732916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.733865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:49.734468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.933513 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.948488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.948747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.950881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-580cac62-2205-418a-ac69-c4b670843254 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.229961 Jul 21 22:53:49.952023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 36/77] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:49 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:50.007198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:50.008561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:50.015291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:50.017193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.017863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.018919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.019489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.154126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.163196 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-71daf356-8388-44b7-a6b3-2b13fbfcdd6b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.160405 Jul 21 22:53:50.163889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 42/78] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:50 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:50.667636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:50.668231 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:50.670386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:50.671058 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:50.674366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.674835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.675628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.676052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.676817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.677265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.678518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.678981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.758171 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.766092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-95576de3-164b-4ce4-a2b9-04b1a5bcbeaa tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1298 microversion: 2.1 time: 0.102397 Jul 21 22:53:50.766671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 37/79] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:50 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:50.828401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.835830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d4c9cc49-300d-4b69-bb49-417cebdbb5ad tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.169219 Jul 21 22:53:50.836404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 43/80] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:50 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:50.970649 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:50.973638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:50.983302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.983915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.985002 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.985584 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.180513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:51.181125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:51.183080 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=22 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:51.188231 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.188866 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.192718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.197099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.197554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.206485 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.208253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.209945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-423fa029-b489-4c5d-a390-cd8cf1be4da4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.244317 Jul 21 22:53:51.210464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 38/81] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:50 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:51.431456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.440666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fa19e109-577f-43c1-9374-337f9d737e2f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.264941 Jul 21 22:53:51.441344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 44/82] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:51 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:51.783866 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:51.784993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:51.790660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.794616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.794616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.794616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.853457 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:51.854017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:51.862387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.862889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.863757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.867076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.868505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.874710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d5da4dee-ef82-4e28-812b-b516e61b841b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1298 microversion: 2.1 time: 0.094846 Jul 21 22:53:51.875322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 39/83] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:51 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:51.972768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=4 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:52.018353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.028243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7855c464-bb10-48d6-af82-342ea86e0ef8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.179037 Jul 21 22:53:52.030150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 45/84] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:51 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:52.228094 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:52.228728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:52.234664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.235164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.235932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.236370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.241664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=10 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:52.373880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.382842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.384639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.386045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-67f1d5c9-b657-4fa7-93df-7531c9023660 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.161866 Jul 21 22:53:52.386615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 40/85] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:52 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:52.457491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:52.458102 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:52.464653 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.465105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.465901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.466339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.600429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.608135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-818574ed-5156-4aa7-9f94-688608aad31f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.154552 Jul 21 22:53:52.608970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 46/86] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:52 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:52.892318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:52.892927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:52.894702 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=34 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:52.900159 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.900606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.901370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.901798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.965304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.977100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c3ff2f6d-f103-4002-9ca2-9ae381830d08 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1298 microversion: 2.1 time: 0.085446 Jul 21 22:53:52.977100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 41/87] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:52 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:53.046300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:53.046931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:53.052968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.053358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.054117 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.054546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.182817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.190450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e28259cd-081f-4e58-acec-461be366aefd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.147915 Jul 21 22:53:53.191049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 47/88] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:53 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:53.405383 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:53.405992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:53.412286 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.412753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.413515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.413952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.563177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.574423 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.577563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.578162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c5702137-a225-4592-be99-7a40f92077de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.176893 Jul 21 22:53:53.582814 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 42/89] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:53 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:53.625352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:53.625953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:53.638091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.638628 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.639331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.639977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.807224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.818686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e60f379f-2b07-4655-a513-0fb87f0ecd90 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.196438 Jul 21 22:53:53.828860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 48/90] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:53 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:53.990881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:53.991502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:53.998458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.998960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.010674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.010674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.016966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:54.063806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.071712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-10e1dde8-bb56-4503-b2d9-3e6b4c155897 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1298 microversion: 2.1 time: 0.085102 Jul 21 22:53:54.072285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 43/91] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:53 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:54.210679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:54.212040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:54.219763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.220578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.221802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.223075 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.410030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.418428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1b36ce29-b59d-4da4-8d5a-5c05a13a90d4 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.213588 Jul 21 22:53:54.419066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 49/92] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:54 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:54.605520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:54.606289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:54.614148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.614638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.615401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.615889 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.779689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.787761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.789251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.790337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-16b9a5dc-5a1d-4f39-9468-7b9ff5c77269 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.188838 Jul 21 22:53:54.790913 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 44/93] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:54 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:54.837306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:54.839951 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:54.847705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.848865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.850118 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.850984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.095896 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:55.097806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:55.111269 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.116092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.116092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.117010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.252371 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.262182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-069c712b-bc78-470f-8d9f-4131a28683bd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1298 microversion: 2.1 time: 0.176251 Jul 21 22:53:55.263015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 45/94] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:55 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:55.373302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.381458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a3269293-0224-437a-85ee-a6c209b08172 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.548655 Jul 21 22:53:55.382599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 50/95] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:54 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:55.440746 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:55.441366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:55.456290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.460091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.464387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.464835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.811391 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:55.813580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:55.824399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.825197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.826496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.827900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.890686 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.910013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ac682399-975f-49dd-a74e-ec302d83c9a2 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.478177 Jul 21 22:53:55.911293 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 46/96] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:55 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:56.026220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.034984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.037207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.038332 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-58c554be-138b-469d-9dab-9ecbf770400d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.234489 Jul 21 22:53:56.039864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 51/97] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:55 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:56.280101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:56.280789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:56.287851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.288353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.289295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.290128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.353017 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.360475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5e770943-0136-4ed2-9b20-1da6e11f0ad6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1296 microversion: 2.1 time: 0.084241 Jul 21 22:53:56.361052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 47/98] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:56 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:56.401899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:56.403267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:56.409934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.410406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.411335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.411890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.590230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.602919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b56ff8a9-4320-408f-b516-c61b5cb23852 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.206223 Jul 21 22:53:56.604311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 52/99] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:56 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:56.928048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:56.929214 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:56.936248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.936952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.937893 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.938497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.058635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:57.059279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:57.076953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.077482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.078447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.078988 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.205297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.215132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-dccf4f64-571c-4bac-a0d9-9f8351981bd1 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.291575 Jul 21 22:53:57.227710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 48/100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:56 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:57.235746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.244315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.245807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.246948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1c9d6df7-c712-4abd-92f4-be2ec4dd2f64 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.193891 Jul 21 22:53:57.247500 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 53/101] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:57 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:57.377510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:57.378250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:57.384402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.384858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.385630 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.386088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.604162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.614110 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7dfe6fc6-b358-4553-a13c-3a9793fd47f6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.240409 Jul 21 22:53:57.624530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:57.624530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:57.625885 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 49/102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:57 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:57.631994 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.632815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.633839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.634531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.822421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.833073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-546b056c-529a-495a-be2f-4bc2b384649c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.215073 Jul 21 22:53:57.834720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 54/103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:57 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:57.875319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-11feeef4-e8ee-40ed-a532-3a0e7443295a req-2fc18a3e-62d5-43a1-86bf-c6fbd9559461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3363b2-6211-444c-8595-b3a40ce92109", "tag": "2d3c9293-bf2d-4f3c-ab9b-47ade12b250a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:57.889589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-11feeef4-e8ee-40ed-a532-3a0e7443295a req-2fc18a3e-62d5-43a1-86bf-c6fbd9559461 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.890048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-11feeef4-e8ee-40ed-a532-3a0e7443295a req-2fc18a3e-62d5-43a1-86bf-c6fbd9559461 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.913930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-11feeef4-e8ee-40ed-a532-3a0e7443295a req-2fc18a3e-62d5-43a1-86bf-c6fbd9559461 service nova] Creating event network-changed:2d3c9293-bf2d-4f3c-ab9b-47ade12b250a for instance 9b3363b2-6211-444c-8595-b3a40ce92109 on hv-cinder-85069 Jul 21 22:53:57.922700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-11feeef4-e8ee-40ed-a532-3a0e7443295a req-2fc18a3e-62d5-43a1-86bf-c6fbd9559461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051841 Jul 21 22:53:57.928735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 50/104] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:58.238199 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:58.239015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:58.247840 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.248290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.254024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.256984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.328849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-58e5293d-90e7-4f65-9c35-2345d420c298 req-d41b0965-14d5-4339-bc7b-0e67bf8b1c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8", "name": "network-vif-plugged", "status": "completed", "tag": "43693aff-eb0b-4fa8-90d5-a5e82416c624"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:53:58.339450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-58e5293d-90e7-4f65-9c35-2345d420c298 req-d41b0965-14d5-4339-bc7b-0e67bf8b1c84 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.339893 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-58e5293d-90e7-4f65-9c35-2345d420c298 req-d41b0965-14d5-4339-bc7b-0e67bf8b1c84 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.354115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-58e5293d-90e7-4f65-9c35-2345d420c298 req-d41b0965-14d5-4339-bc7b-0e67bf8b1c84 service nova] Creating event network-vif-plugged:43693aff-eb0b-4fa8-90d5-a5e82416c624 for instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 on hv-cinder-85069 Jul 21 22:53:58.359589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-58e5293d-90e7-4f65-9c35-2345d420c298 req-d41b0965-14d5-4339-bc7b-0e67bf8b1c84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128617 Jul 21 22:53:58.360799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 51/105] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:53:58.367399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:58.368342 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:58.375308 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.376100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.377256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.377900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.521326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:58.531547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7c97bc20-a0d7-41ba-9945-2dcafbeb0565 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.301921 Jul 21 22:53:58.535293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 55/106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:58 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:58.632357 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:58.633010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:58.651895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.652827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.653638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.654079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.687438 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:58.914720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:58.927676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-93a866fe-2f70-47e3-9bcb-e4e1b5d4577d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.295480 Jul 21 22:53:58.928304 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 56/107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:58 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:58.945429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:58.946048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:58.952261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.952898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.953664 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.954095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:59.025306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:59.036127 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:59.040892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:59.042641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f5fc7832-7cd4-4308-9cbc-012ad1f84b41 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.680562 Jul 21 22:53:59.043590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 52/108] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:58 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:59.097650 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:59.105313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dddb5432-1441-45f9-bfa4-df2b1838e837 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.171649 Jul 21 22:53:59.105887 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 57/109] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:58 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:59.551069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:59.551588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:59.558164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:59.558601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:59.560516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:59.560516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:59.709724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:59.717676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e10af744-00f2-49b7-a1c7-f95b98686546 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.170469 Jul 21 22:53:59.726992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 53/110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:59 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:59.952243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:59.953162 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:59.961427 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:59.962371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:59.963702 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:59.964701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.061943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:00.061943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:00.068897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.069409 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.070189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.070791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.113534 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.123223 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7c58f91c-6bec-4093-bbb4-913168be0e16 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.177072 Jul 21 22:54:00.124273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 58/111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:59 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:00.129906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:00.131324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:00.137881 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.138334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.139347 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.139798 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.263496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.272923 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.274527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.275739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b1066d8c-38c3-4d23-bab8-2ec83a59322d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.218635 Jul 21 22:54:00.276617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 54/112] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:00 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:00.322679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.333094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1cbfeffe-5627-4c80-b586-7213b6aeac65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.207488 Jul 21 22:54:00.333683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 59/113] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:00 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:00.423871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-8bb46d43-4ca8-4f4f-b948-e921662bc2cc req-5dda00f6-2569-405c-b7aa-c78fe106eed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f21ad4b-325d-4945-91ee-58ed919e892c", "name": "network-vif-plugged", "status": "completed", "tag": "2b3bc926-e36a-4b2b-a85a-0356b93dec8b"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:00.436619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8bb46d43-4ca8-4f4f-b948-e921662bc2cc req-5dda00f6-2569-405c-b7aa-c78fe106eed8 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.439268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8bb46d43-4ca8-4f4f-b948-e921662bc2cc req-5dda00f6-2569-405c-b7aa-c78fe106eed8 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.452155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-8bb46d43-4ca8-4f4f-b948-e921662bc2cc req-5dda00f6-2569-405c-b7aa-c78fe106eed8 service nova] Creating event network-vif-plugged:2b3bc926-e36a-4b2b-a85a-0356b93dec8b for instance 0f21ad4b-325d-4945-91ee-58ed919e892c on hv-cinder-85069 Jul 21 22:54:00.457549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-8bb46d43-4ca8-4f4f-b948-e921662bc2cc req-5dda00f6-2569-405c-b7aa-c78fe106eed8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040275 Jul 21 22:54:00.458519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 55/114] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:00.736063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:00.736884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:00.743644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.744278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.745063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.745495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.878938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.886880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ea7a7bde-82c7-44fb-bcb2-39c951de8b54 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.155391 Jul 21 22:54:00.887444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 60/115] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:00 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:01.147751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:01.149476 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:01.162063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.162063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.162063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.162063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.292569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.294520 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:01.295161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:01.300780 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a62f7f01-5d1e-4d04-b056-dfe6567f5bbe tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.161426 Jul 21 22:54:01.301133 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.301383 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 56/116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:01 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:01.301589 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.302465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.302935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.349702 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:01.350304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:01.356441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.356894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.357652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.358084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.437732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.448311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.449970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.451210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-11e6d719-1771-4c6e-ab4e-2dca80ce4906 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.160610 Jul 21 22:54:01.452041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 61/117] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:01 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:01.496276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.506901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d4472c50-493b-4c0e-b577-9e20204d6dad tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.160700 Jul 21 22:54:01.507239 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 57/118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:01 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:01.904046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:01.904664 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:01.910804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.911237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.911997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.912438 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.065750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.074147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-79a373fa-9ba1-4a2e-a23e-3c5949f3a05a tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.174030 Jul 21 22:54:02.074706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 62/119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:01 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:02.317893 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:02.319874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:02.327193 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.327681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.328569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.329197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.471642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:02.472832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:02.480292 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.481302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.481975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.482991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.483567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.490345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b69c4298-8f91-4b3f-9fa5-2bf90bcfe6c3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.176784 Jul 21 22:54:02.492193 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 58/120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:02 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:02.497191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-51768434-fb36-4a0b-8648-b888582f3440 req-9b7c0455-0fc7-4ff4-a179-a3d0cb81c424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3616f76-15d6-4940-9c44-8cf771d3b170", "name": "network-vif-plugged", "status": "completed", "tag": "d8513c0b-5706-4b5d-bf3c-154536ce5049"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:02.507612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-51768434-fb36-4a0b-8648-b888582f3440 req-9b7c0455-0fc7-4ff4-a179-a3d0cb81c424 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.508182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-51768434-fb36-4a0b-8648-b888582f3440 req-9b7c0455-0fc7-4ff4-a179-a3d0cb81c424 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.519910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-51768434-fb36-4a0b-8648-b888582f3440 req-9b7c0455-0fc7-4ff4-a179-a3d0cb81c424 service nova] Creating event network-vif-plugged:d8513c0b-5706-4b5d-bf3c-154536ce5049 for instance d3616f76-15d6-4940-9c44-8cf771d3b170 on hv-cinder-85069 Jul 21 22:54:02.525318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-51768434-fb36-4a0b-8648-b888582f3440 req-9b7c0455-0fc7-4ff4-a179-a3d0cb81c424 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031787 Jul 21 22:54:02.526174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 59/121] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:02.531387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:02.532323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:02.538741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.539227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.539996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.540424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.631522 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.639790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.641343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.643359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cbacc8a5-956e-4046-894a-86bfa043f86e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.177097 Jul 21 22:54:02.643704 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 63/122] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:02 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:02.692016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.700261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-11ba9c19-8589-4485-952b-ce0a9dc85cfe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.172734 Jul 21 22:54:02.700836 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:02 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:03.092619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:03.093506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:03.106038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.106484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.107397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.107830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.259975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.268135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a41b85a5-275a-49c3-9139-38e0a8f96690 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.179582 Jul 21 22:54:03.268778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 64/124] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:03 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:03.510046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:03.511125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:03.517592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.518042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.518840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.519262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.655938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.661746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:03.663174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:03.664326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cea26a1d-5ac4-4408-920e-28cee521a21d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.158593 Jul 21 22:54:03.664923 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 61/125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:03 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:03.674904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.680085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.681325 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.683005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.719953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:03.719953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:03.725849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.727414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.728439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.729194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.865173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.874570 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.876203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.877321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b5844852-512f-43e7-b65a-ebc2fa28407e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.220133 Jul 21 22:54:03.878008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 65/126] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:03 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:03.972392 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.976239 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:03.996453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f7c35a9f-d396-468b-aa53-9e9540477966 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.280317 Jul 21 22:54:03.997362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 62/127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:03 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:04.287587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:04.288185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:04.294261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.294700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.295542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.295970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.436921 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:04.444780 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0cd5fbf3-e490-4f82-9313-9b2ed93dc797 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.162127 Jul 21 22:54:04.445488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 66/128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:04 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:04.545361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-da89be91-2f33-4dca-95a1-31ba3b78cfe4 req-5f53e006-6b8a-4076-b779-317afd3ca9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "name": "network-vif-plugged", "status": "completed", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:04.554595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-da89be91-2f33-4dca-95a1-31ba3b78cfe4 req-5f53e006-6b8a-4076-b779-317afd3ca9a7 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.555056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-da89be91-2f33-4dca-95a1-31ba3b78cfe4 req-5f53e006-6b8a-4076-b779-317afd3ca9a7 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.568315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-da89be91-2f33-4dca-95a1-31ba3b78cfe4 req-5f53e006-6b8a-4076-b779-317afd3ca9a7 service nova] Creating event network-vif-plugged:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:54:04.573085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-da89be91-2f33-4dca-95a1-31ba3b78cfe4 req-5f53e006-6b8a-4076-b779-317afd3ca9a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Jul 21 22:54:04.573714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 63/129] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:54:04.681788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:04.682404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:04.688387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.689013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.689779 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.690217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.821227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:04.829569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-70a0efb0-8f9b-4b2e-8fe7-b7292b818ebd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.151352 Jul 21 22:54:04.830159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 67/130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:04 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:04.896474 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:04.897158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:04.903471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.903914 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.904663 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.905090 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.013505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:05.014122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:05.019992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.020986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.021763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.022342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.044970 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.065063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.065063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.065063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4d1715d6-8e18-48e0-a4b3-fd75aae4c860 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.164147 Jul 21 22:54:05.065387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 64/131] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:04 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:05.155243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.162901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-db2998bc-b0a0-417a-9682-ae809fcdc9cd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.153310 Jul 21 22:54:05.163516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 68/132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:05 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:05.461506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:05.462111 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:05.468897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.469390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.470197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.470639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.603563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.611343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a8356a3e-ff5d-4c3c-adb4-f7e1d40d16b5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.153721 Jul 21 22:54:05.611920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 65/133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:05 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:05.847331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:05.847940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:05.854532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.855090 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.855906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.856468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.989654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.998571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-471ebcc3-29ea-43ab-b82d-922477ea8181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.155039 Jul 21 22:54:05.999167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:05 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:06.081281 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:06.081880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:06.087969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.088415 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.089170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.089602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.180603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:06.181316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:06.187189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.187642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.188413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.188844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.219506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.228700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.230192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.231323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fef81911-36db-4706-9458-ea9bfbbdd687 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.153905 Jul 21 22:54:06.231946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 66/135] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:06 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:06.319692 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.327268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-836b6623-444f-4174-b412-51d6f7bf7736 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.151001 Jul 21 22:54:06.327836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:06 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:06.630373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:06.631040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:06.637073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.637519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.638280 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.638712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.762195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.769571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1bc20af6-3cf9-4634-aedb-7a2bfd3347fd tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1314 microversion: 2.1 time: 0.143580 Jul 21 22:54:06.770135 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 67/137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:06 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:07.014458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:07.015097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:07.021250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.021729 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.022530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.023003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.155146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.162595 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-80253aab-e6f1-46d9-965a-236bc6e5436f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.152270 Jul 21 22:54:07.163186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 71/138] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:07 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:07.249386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:07.249994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:07.257035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.257418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.258190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.258713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.345745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:07.346352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:07.355699 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.356150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.356915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.357355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.403372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.414414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.418042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.419841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-652c4791-c8df-45cd-bcfe-21b568b2ad5e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.174295 Jul 21 22:54:07.420747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 68/139] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:07 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:07.534732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.543097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c5c83e3a-9897-4ead-91e0-b86183ebd622 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.201753 Jul 21 22:54:07.543686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 72/140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:07 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:07.787098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:07.787632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:07.793796 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.794245 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.795128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.795467 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.924487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.934302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-35c31870-9bb4-49c9-a8e7-d97c96ae86f5 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1501 microversion: 2.1 time: 0.151793 Jul 21 22:54:07.934904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 69/141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:07 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:08.179350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:08.180164 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:08.187360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.187809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.188581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.189009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.193757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:08.329820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.338650 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-83f9a142-9b0d-4e80-a4a7-ac7c0756f61d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.163671 Jul 21 22:54:08.339155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:08 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:08.438319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:08.439314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:08.446107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.446661 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.447491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.447933 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.560675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:08.561205 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:08.569081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.569535 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.570329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.570973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.588080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.611437 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.613657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.618715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f2923d8a-90d8-4648-8fa5-7bb35df1712e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.184523 Jul 21 22:54:08.632830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 70/143] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:08 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:08.862549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.871542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-04c7c62f-411e-4968-8a13-ce25a4f40c47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1321 microversion: 2.1 time: 0.314806 Jul 21 22:54:08.874277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 74/144] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:08 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:09.355668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:09.356278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:09.362129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.362568 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.363362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.363798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.504193 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:09.514307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-18930f05-4175-47bc-9de3-f17ea1cdeb39 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.160723 Jul 21 22:54:09.514307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 71/145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:09 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:09.639794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:09.641704 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:09.648530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.648978 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.649745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.650847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.818210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:09.826546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:09.828336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:09.829441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7140bc1d-28ba-4e97-8351-077068ed0884 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.193638 Jul 21 22:54:09.829998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 75/146] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:09 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:09.888625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:09.888748 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c1a1ee-d314-48f8-84bb-9bb0e1240739"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:09.889219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:09.890044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:09.896295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.896741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.896892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.897320 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.897505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.897973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.898834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.899431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.085588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:10.097318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9c5137f1-5024-4b61-9abe-2861c0142de5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1514 microversion: 2.1 time: 0.212075 Jul 21 22:54:10.099551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 76/147] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:09 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:10.135345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:10.136462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:10.144271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.147202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.148446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.148965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.249668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lazy-loading 'flavor' on Instance uuid d3616f76-15d6-4940-9c44-8cf771d3b170 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:54:10.703656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cc5e2742-bb92-402f-84bc-803e18c0c235 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170/action" status: 200 len: 32 microversion: 2.1 time: 0.591551 Jul 21 22:54:10.704189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 77/148] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:54:10 2022] POST /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170/action => generated 32 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 22:54:10.712036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-38cb050f-cdf7-4713-a4b0-ba1d5ec7f564 req-578557a0-d77f-4253-b6f7-1fcf23bab7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3363b2-6211-444c-8595-b3a40ce92109", "name": "network-vif-plugged", "status": "completed", "tag": "2d3c9293-bf2d-4f3c-ab9b-47ade12b250a"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:10.736974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-38cb050f-cdf7-4713-a4b0-ba1d5ec7f564 req-578557a0-d77f-4253-b6f7-1fcf23bab7c3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.736974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-38cb050f-cdf7-4713-a4b0-ba1d5ec7f564 req-578557a0-d77f-4253-b6f7-1fcf23bab7c3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.748759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-38cb050f-cdf7-4713-a4b0-ba1d5ec7f564 req-578557a0-d77f-4253-b6f7-1fcf23bab7c3 service nova] Creating event network-vif-plugged:2d3c9293-bf2d-4f3c-ab9b-47ade12b250a for instance 9b3363b2-6211-444c-8595-b3a40ce92109 on hv-cinder-85069 Jul 21 22:54:10.754713 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-38cb050f-cdf7-4713-a4b0-ba1d5ec7f564 req-578557a0-d77f-4253-b6f7-1fcf23bab7c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049345 Jul 21 22:54:10.755518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 78/149] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:10.765695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:10.766483 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:10.773686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.774127 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.774914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.775796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.895876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a2aa476d-a1e4-4154-b6b8-3e5bf1fbfc17 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "POST /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.010749 Jul 21 22:54:10.902858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 72/150] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:54:09 2022] POST /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:10.909114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:10.910021 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:10.920288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:10.923847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.924634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.925646 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:10.926440 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.967960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:10.983207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4c8028d4-885f-4129-b960-03e36e97578b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.222325 Jul 21 22:54:10.983888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 79/151] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:10 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:11.006987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:11.007594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:11.014850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:11.015303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:11.016817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:11.017257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:11.173248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.179229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a8f1a080-8123-47e7-be32-701372992107 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.274918 Jul 21 22:54:11.179892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 73/152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:10 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:11.200683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.209681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.211788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.212941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e0521427-1eab-4e78-ac16-d6eefc0dbf01 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1407 microversion: 2.20 time: 0.227296 Jul 21 22:54:11.213505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 80/153] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:10 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:12.004285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:12.004933 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:12.012225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.012686 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.013450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.013902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.282499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.282499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-19aaff0f-06b2-408c-a0af-6a9bd0900554 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.171997 Jul 21 22:54:12.282499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 74/154] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:11 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:12.282811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:12.282811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:12.282811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.282811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.283410 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.283410 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.283590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:12.283590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:12.283590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.283590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.284275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.284275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.373286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.381657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3a3d7890-78aa-4609-b6e8-763882e6cbd8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.189178 Jul 21 22:54:12.386828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 81/155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:12 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:12.394060 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.402909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.404395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.405554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-24d73e2f-7a6a-44e8-b191-fb47ef744252 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1599 microversion: 2.20 time: 0.178734 Jul 21 22:54:12.406137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 75/156] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:12 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:12.435086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:12.435916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:12.443621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.444317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.445244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.445828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.540124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b7341c8f-112b-4e46-89c4-8c5825554ce0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109520 Jul 21 22:54:12.540747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 82/157] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jul 21 22:54:12 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:54:13.291448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:13.292173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:13.299052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.299497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.300276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.300707 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.400188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:13.401348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:13.415687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.416489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.417440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.418042 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.485274 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:13.500548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a687f79f-4e68-43a5-b932-73b72d5ae5bc tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1363 microversion: 2.1 time: 0.213356 Jul 21 22:54:13.501614 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 76/158] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:13 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:13.729368 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:13.739422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-50a3c0da-a4d2-4533-ad09-102a369c23b4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.343284 Jul 21 22:54:13.740232 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 83/159] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:13 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:14.204256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-764575c3-a6bc-4299-98ab-9cb52a7140fc req-12548ab2-62c7-4911-bb4d-7cff4827e963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:14.214453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-764575c3-a6bc-4299-98ab-9cb52a7140fc req-12548ab2-62c7-4911-bb4d-7cff4827e963 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.224341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-764575c3-a6bc-4299-98ab-9cb52a7140fc req-12548ab2-62c7-4911-bb4d-7cff4827e963 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.235846 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-764575c3-a6bc-4299-98ab-9cb52a7140fc req-12548ab2-62c7-4911-bb4d-7cff4827e963 service nova] Creating event network-changed:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:54:14.250377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-764575c3-a6bc-4299-98ab-9cb52a7140fc req-12548ab2-62c7-4911-bb4d-7cff4827e963 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046886 Jul 21 22:54:14.250377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 77/160] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:14.518198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:14.522505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:14.527822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.532491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.533554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.537569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.760682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:14.764426 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:14.782596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.783137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.787031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.792482 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.815107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:14.826043 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0ed88e72-65f5-46de-b7a9-f7eb2b199fe0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1550 microversion: 2.1 time: 0.311843 Jul 21 22:54:14.828725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 84/161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:14 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1550 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:14.849585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:14.853047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:14.862498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.864226 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.867385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.868421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:15.015770 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c35f0088-bb30-4d5d-abfa-0df0bc8f4459 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171351 Jul 21 22:54:15.016855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 85/162] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:54:14 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:15.675581 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:15.689023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d48ac84d-dff5-4bff-be47-f6f692fb5053 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.935458 Jul 21 22:54:15.689604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 78/163] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:14 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:16.711136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:16.711738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:16.718353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:16.718818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:16.720453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:16.720453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:16.946112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:16.962085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ee3e9b2-3500-433e-b81a-f7d73d02c9ab tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.255311 Jul 21 22:54:16.963301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 86/164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:16 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:17.272218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-3946b188-01e4-4b23-a2f3-62aea6ccad66 req-d9ded9aa-050a-408f-8316-0f5f49d378bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3363b2-6211-444c-8595-b3a40ce92109", "tag": "2d3c9293-bf2d-4f3c-ab9b-47ade12b250a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:17.298807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-3946b188-01e4-4b23-a2f3-62aea6ccad66 req-d9ded9aa-050a-408f-8316-0f5f49d378bd service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:17.299468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-3946b188-01e4-4b23-a2f3-62aea6ccad66 req-d9ded9aa-050a-408f-8316-0f5f49d378bd service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:17.325322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-3946b188-01e4-4b23-a2f3-62aea6ccad66 req-d9ded9aa-050a-408f-8316-0f5f49d378bd service nova] Creating event network-changed:2d3c9293-bf2d-4f3c-ab9b-47ade12b250a for instance 9b3363b2-6211-444c-8595-b3a40ce92109 on hv-cinder-85069 Jul 21 22:54:17.344580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-3946b188-01e4-4b23-a2f3-62aea6ccad66 req-d9ded9aa-050a-408f-8316-0f5f49d378bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076603 Jul 21 22:54:17.347720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 79/165] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:54:17.980416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:17.982059 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:17.989514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:17.990243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:17.991508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:17.995549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:18.193308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:18.202698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0d981637-b5eb-4d73-b41f-6b6c3ef20ff2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.226763 Jul 21 22:54:18.215025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 87/166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:17 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:19.221587 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:19.222488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:19.229871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:19.230308 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:19.231118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:19.231551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:19.235806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:19.370227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:19.377611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ade92eec-2252-4256-bc97-77cb1b6ee11b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.160764 Jul 21 22:54:19.378200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 80/167] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:19 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:20.395337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:20.395975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:20.401878 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:20.402328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:20.403157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:20.403588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:20.535418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:20.543219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-17a8f24c-e63d-4ccf-bfe0-c25aa40e3174 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.152340 Jul 21 22:54:20.543804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 88/168] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:20 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:21.560917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:21.561540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:21.569271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:21.569720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:21.570488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:21.570974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:21.706500 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:21.719293 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9be06b02-33ec-45a0-9bfc-2f464f3e1926 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.162031 Jul 21 22:54:21.722020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 81/169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:21 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:22.738587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:22.739228 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:22.741321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=93 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:22.746037 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:22.746486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:22.747277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:22.747707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:22.751661 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:22.890048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:22.898519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-940ab3ed-372d-4dc4-b0fb-9f279ac61cfd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.163840 Jul 21 22:54:22.899128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 89/170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:22 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:23.264141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:23.264639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:23.271763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.272210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.272974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.273408 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.297667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:54:23.630737 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9e15d07c-8343-4ee6-9b6f-7aaf5434c522 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 204 len: 0 microversion: 2.1 time: 0.370132 Jul 21 22:54:23.631633 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 82/171] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:54:23 2022] DELETE /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:54:23.640599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:23.642949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:23.647152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.647599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.648365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.648800 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.785869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:23.794098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f0ed3bd1-9d8e-4fd9-84aa-bcce2333fac7 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.158014 Jul 21 22:54:23.794666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 90/172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:23 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:23.916843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:23.917546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:23.924210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.924656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.925429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.926529 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:24.058675 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:24.066068 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c8bcce0d-3d78-45b3-ad35-df1b017ef8c7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.153546 Jul 21 22:54:24.066851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 83/173] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:23 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:24.812170 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:24.812769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:24.819885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:24.820329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:24.821085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:24.821524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:24.959402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:24.967578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c4a9a560-e089-4f48-89cb-7e84a242d940 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.159056 Jul 21 22:54:24.968129 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 91/174] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:24 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:25.082725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:25.083401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:25.089871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.090321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:25.091125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.091557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:25.232134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:25.240167 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0fe630a3-9450-4f25-9314-b24bc1f32936 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.161366 Jul 21 22:54:25.240742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 84/175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:25 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:25.984675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:25.985359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:25.991422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.991868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:25.992619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.993049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:26.119935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:26.127911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-846844ce-826e-42fa-9be8-3b565433a767 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.147240 Jul 21 22:54:26.128475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 92/176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:25 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:26.256948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:26.257485 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:26.263956 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:26.264405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:26.265166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:26.265601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:26.394336 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:26.402678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f7cc1307-f0dc-4216-909c-7e9079e96d56 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.150126 Jul 21 22:54:26.403276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 85/177] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:26 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:27.145984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:27.146581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:27.152645 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:27.153094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:27.153842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:27.154273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:27.280509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:27.289121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9004e6ed-a5b0-41e2-b549-f99cac0b48e3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.147549 Jul 21 22:54:27.289691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 93/178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:27 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:27.423449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:27.424369 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:27.430636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:27.431120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:27.431892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:27.432325 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:27.566845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:27.574802 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c3c90d1b-9c6d-4fc2-9dff-5834277db134 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.155321 Jul 21 22:54:27.575381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 86/179] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:27 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:28.308538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:28.309153 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:28.316643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.317072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.317847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.318327 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.450605 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:28.458603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a9031ad-e8b2-4fff-bd82-fcaa3aa4f031 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.155231 Jul 21 22:54:28.459214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 94/180] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:28 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:28.593597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:28.594215 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:28.601828 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.602278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.603078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.603513 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.732639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:28.740048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1ea2ca8b-b14b-406d-87bc-64648ad47a4d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.151011 Jul 21 22:54:28.740617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 87/181] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:28 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:29.477718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:29.478917 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:29.484938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.485461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.486189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.486626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.625112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:29.635364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-558d0f91-b380-49c3-88fa-267daa99ded8 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.161846 Jul 21 22:54:29.635940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 95/182] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:29 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:29.757355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:29.758064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:29.765768 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.766247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.767054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.767502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.909723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:29.917601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-29dea9e5-c11a-40d4-aedc-5cb64928fe31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.165046 Jul 21 22:54:29.918170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 88/183] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:29 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:30.652577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:30.653182 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:30.659372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.659815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:30.660575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.661050 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:30.791834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:30.800009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-639ee66d-ab18-4888-a634-e46a8c953cdb tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.151333 Jul 21 22:54:30.800573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 96/184] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:30 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:30.934386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:30.935179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:30.941613 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.942698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:30.945037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.945037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:31.077906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:31.085356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-27bbbbff-848d-409d-9d34-d1a282e7eced tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.154752 Jul 21 22:54:31.085916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 89/185] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:30 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:31.817323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:31.817879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:31.828059 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:31.828584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:31.829346 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:31.836666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:31.973683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:31.982372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-58aa8349-c814-4eb8-bb3a-af4cfbd6b258 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1553 microversion: 2.1 time: 0.168941 Jul 21 22:54:31.983025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 97/186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:31 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:32.102656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:32.103288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:32.109652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:32.110097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:32.110878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:32.111312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:32.262212 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:32.270890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8de61e77-2224-4261-a853-b59ecabf1faa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.171629 Jul 21 22:54:32.271477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 90/187] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:32 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:32.387259 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-4d545d8e-ad51-40f2-8b91-eecf78eb9d00 req-ed9d5199-0c64-4496-a7a2-008deba1f561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8", "name": "network-vif-deleted", "tag": "43693aff-eb0b-4fa8-90d5-a5e82416c624"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:32.396260 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4d545d8e-ad51-40f2-8b91-eecf78eb9d00 req-ed9d5199-0c64-4496-a7a2-008deba1f561 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:32.398184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4d545d8e-ad51-40f2-8b91-eecf78eb9d00 req-ed9d5199-0c64-4496-a7a2-008deba1f561 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:32.410125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-4d545d8e-ad51-40f2-8b91-eecf78eb9d00 req-ed9d5199-0c64-4496-a7a2-008deba1f561 service nova] Creating event network-vif-deleted:43693aff-eb0b-4fa8-90d5-a5e82416c624 for instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 on hv-cinder-85069 Jul 21 22:54:32.415578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-4d545d8e-ad51-40f2-8b91-eecf78eb9d00 req-ed9d5199-0c64-4496-a7a2-008deba1f561 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Jul 21 22:54:32.416657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 98/188] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:33.000185 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:33.000907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:33.007679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.008411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.009875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.010636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.092347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0902f6348840729a6ce7a97167da9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0db0569e094eccb3e8fc578a16fc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:33.104228 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c9e93d1e-e36a-4e58-ad95-5bf1a449fcf3 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 200 len: 1345 microversion: 2.1 time: 0.107877 Jul 21 22:54:33.107158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 91/189] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:32 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:33.288307 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:33.289001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:33.295145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.295631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.296576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.297321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.450027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:33.460246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fb239060-2832-46df-a4ea-0fb3f261e713 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.176206 Jul 21 22:54:33.461505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 99/190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:33 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:34.121063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:34.121660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:34.128100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.128542 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.129294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.129741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.142928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] HTTP exception thrown: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Request method failure captured: Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 HTTP/1.1 Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djgTOnnzkIldT5yP1nF0tyY4olGXlkHBpbt8PboBHxlQd3oiE6TklR8MEceIE-Gs-mUuvZzjSpko3B7pCgeK6PPC3YAGyfZs-tLvnqFuQY0FeKGbNhWVIIKk7f_GTc0GJMLEfAB__7zElhwR79LYKwKglLFpDiw2OaesKk6qXha6AI Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:54:34.148070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba0db0569e094eccb3e8fc578a16fc1e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ca0902f6348840729a6ce7a97167da9c Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.149524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8'} Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:54:34.150401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.151585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.152577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Returning 404 to user: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:54:34.152577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f4f31580-ca8d-4399-9a17-da1f6df1a947 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 404 len: 111 microversion: 2.1 time: 0.032224 Jul 21 22:54:34.152577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 92/191] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:34 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:54:34.253879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:34.255423 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:34.261426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.261864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.262609 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.263070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.276105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] HTTP exception thrown: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Request method failure captured: Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8/os-volume_attachments HTTP/1.1 Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djgTOnnzkIldT5yP1nF0tyY4olGXlkHBpbt8PboBHxlQd3oiE6TklR8MEceIE-Gs-mUuvZzjSpko3B7pCgeK6PPC3YAGyfZs-tLvnqFuQY0FeKGbNhWVIIKk7f_GTc0GJMLEfAB__7zElhwR79LYKwKglLFpDiw2OaesKk6qXha6AI Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:54:34.287015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba0db0569e094eccb3e8fc578a16fc1e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ca0902f6348840729a6ce7a97167da9c Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.288264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'server_id': 'bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8'} Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:54:34.289358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:34.290710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:34.291783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Returning 404 to user: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:54:34.291783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7b14a752-a763-45f6-898f-534d07effb34 tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038606 Jul 21 22:54:34.291783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 100/192] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:54:34 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:54:34.481758 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:34.482378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:34.488794 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.489278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.490101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.490535 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.633906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:34.643035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-35f807bc-f62f-4811-b730-4e7c71575931 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.165365 Jul 21 22:54:34.649312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 93/193] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:34 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:35.660317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:35.661512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:35.667669 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:35.668121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:35.668881 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:35.669330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:35.797460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:35.804803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1d19f24c-91e0-4c72-b56d-fd16a2cc5ea0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.148388 Jul 21 22:54:35.805356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 101/194] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:35 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:36.822207 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:36.823254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:36.830821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:36.831271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:36.832029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:36.832470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:36.959353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:36.966697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-68f8e27f-1203-4b9a-b18d-d72c69d35eee tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.149191 Jul 21 22:54:36.967551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 94/195] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:36 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:37.984357 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:37.984951 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:37.991697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:37.992136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:37.992882 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:37.995157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.130356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:38.138639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fc7f2dea-c0ad-46be-9447-3f6a4374a3fc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.158027 Jul 21 22:54:38.139513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 102/196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:37 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:38.786256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:38.786870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:38.793528 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:38.793977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.794737 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:38.795216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.812140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] HTTP exception thrown: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Request method failure captured: Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 HTTP/1.1 Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djgTOnnzkIldT5yP1nF0tyY4olGXlkHBpbt8PboBHxlQd3oiE6TklR8MEceIE-Gs-mUuvZzjSpko3B7pCgeK6PPC3YAGyfZs-tLvnqFuQY0FeKGbNhWVIIKk7f_GTc0GJMLEfAB__7zElhwR79LYKwKglLFpDiw2OaesKk6qXha6AI Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:54:38.813920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba0db0569e094eccb3e8fc578a16fc1e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ca0902f6348840729a6ce7a97167da9c Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.815388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8'} Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:54:38.816188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.817623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.819465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Returning 404 to user: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:54:38.819465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ef4ec0b0-d88e-4787-92d5-f6bafe4bbaae tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 404 len: 111 microversion: 2.1 time: 0.032980 Jul 21 22:54:38.819465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 95/197] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:54:38 2022] DELETE /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:54:38.827967 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:38.828570 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] [instance: bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:38.835655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:38.836095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.836955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:38.837388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.852513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] HTTP exception thrown: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Request method failure captured: Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 HTTP/1.1 Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djgTOnnzkIldT5yP1nF0tyY4olGXlkHBpbt8PboBHxlQd3oiE6TklR8MEceIE-Gs-mUuvZzjSpko3B7pCgeK6PPC3YAGyfZs-tLvnqFuQY0FeKGbNhWVIIKk7f_GTc0GJMLEfAB__7zElhwR79LYKwKglLFpDiw2OaesKk6qXha6AI Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:54:38.854670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba0db0569e094eccb3e8fc578a16fc1e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba0db0569e094eccb3e8fc578a16fc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: ba0db0569e094eccb3e8fc578a16fc1e Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-DeleteServersTestJSON-1505402980 Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ca0902f6348840729a6ce7a97167da9c Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-DeleteServersTestJSON-1505402980-project Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.856091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8'} Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:54:38.868113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. Jul 21 22:54:38.869532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:54:38.870681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] Returning 404 to user: Instance bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:54:38.870681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3e904c52-b357-4c99-9766-0d7b91ba923d tempest-DeleteServersTestJSON-1505402980 tempest-DeleteServersTestJSON-1505402980-project] 10.222.0.52 "GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8" status: 404 len: 111 microversion: 2.1 time: 0.032166 Jul 21 22:54:38.870681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 103/198] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:38 2022] GET /compute/v2.1/servers/bee6663b-29ea-48eb-a9f9-c6cdbd57fbc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:54:39.156264 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:39.156870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:39.163762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:39.164218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:39.165000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:39.165436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:39.184977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:39.335496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:39.345260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-216a5687-f34e-4dd5-8873-c2257e4af29a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.192653 Jul 21 22:54:39.359275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 96/199] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:39 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:40.366667 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:40.368338 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:40.375680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:40.376339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:40.377426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:40.382717 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:40.665908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:40.674365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-37f3ec05-e36e-4aad-82ee-fdf5cdbea543 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.312740 Jul 21 22:54:40.675367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 104/200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:40 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:41.691404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:41.692690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:41.712262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:41.712695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:41.716109 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:41.716600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:42.247404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:42.256629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a33b921c-35f5-4234-a833-6ee89b9a0ddb tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.569023 Jul 21 22:54:42.257296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 97/201] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:41 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:43.274476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:43.276684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:43.282078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:43.287674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:43.288488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:43.288920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:43.551258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:43.561201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-420a0512-3059-4c9f-bcff-bd43854d4858 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.291239 Jul 21 22:54:43.562186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 105/202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:43 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:44.578894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:44.579569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:44.582894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:44.587129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:44.587773 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:44.588901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:44.589352 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:44.731260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:44.737860 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a9ce28d6-f8ec-472f-95e0-1a90e12a6539 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.162973 Jul 21 22:54:44.738427 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 98/203] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:44 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:45.758465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:45.760845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:45.769748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:45.769748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:45.770834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:45.771366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:45.911555 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:45.919923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-150aa610-920b-4a28-a8bd-86b05f9057d2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.168600 Jul 21 22:54:45.920797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 106/204] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:45 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:46.943874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:46.944486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:46.952249 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:46.952709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:46.953460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:46.954055 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:47.116470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:47.124034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7d7efdc1-7fc9-43c0-93b8-81c212d4d637 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.186518 Jul 21 22:54:47.124691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 99/205] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:46 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:48.142141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:48.143380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:48.149920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:48.150359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:48.151177 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:48.151601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:48.307909 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:48.311612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:48.316321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-06cdc9c0-8e99-4f7c-a7e3-41238744d2a0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.178484 Jul 21 22:54:48.316894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 107/206] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:48 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:49.334399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:49.337400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:49.349780 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:49.350478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:49.351642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:49.352236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:49.678503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:49.688922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-84e0be74-a638-4bea-b7f1-29f512032c10 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.359086 Jul 21 22:54:49.697366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 100/207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:49 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:50.707220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:50.708268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:50.725466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:50.726254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:50.732359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:50.733052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:51.087814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:51.135838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f55d6a22-5812-4fbe-b7c1-6f6a18c36a08 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.433849 Jul 21 22:54:51.139317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 108/208] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:50 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:52.164054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:52.169103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:52.180801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:52.182632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:52.183673 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:52.184450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:52.427808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:52.437083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7dad5f1c-82fc-4020-afec-2c59f3f42014 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.286910 Jul 21 22:54:52.437957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 101/209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:52 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:54:53.454909 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:53.455514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:53.458121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=40 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:53.466229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:53.471122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:53.472043 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:53.472494 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:53.812941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:53.826988 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-78c09274-5c8c-4938-a7cf-8cbaa346d2a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.376694 Jul 21 22:54:53.830189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 109/210] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:53 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:54.847261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:54.848554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:54.859924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:54.860624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:54.861558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:54.862437 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:55.268831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:55.284331 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2298c127-bbb9-43af-8438-89960254ced6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.441174 Jul 21 22:54:55.285416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 102/211] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:54 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:56.315348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:56.315901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:56.329067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:56.329575 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:56.330271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:56.330709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:56.415952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3801e3c2-eb62-41aa-bd7d-61c96bc4d44c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: .version_select at 0x7fc5d75c9dc0>, body: {"keypair": {"name": "tempest-keypair-670950779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVhMwky/z1PfqPA3BJuRWpxkh9ozgXOZqoCsaRSbn8baBlAGRzwtn/cpora4NJxYlCMszNpXF6hTJnQKsPCXJ9p2TakB6hEl/9mPkZLHo+5Phv+COTj4jlm12tvW4I94Q=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:56.438039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-3801e3c2-eb62-41aa-bd7d-61c96bc4d44c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:54:56.450248 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-3801e3c2-eb62-41aa-bd7d-61c96bc4d44c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:54:56.574449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3801e3c2-eb62-41aa-bd7d-61c96bc4d44c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.401740 Jul 21 22:54:56.589264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 110/212] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:54:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:54:56.669973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:56.689527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2b8f78d8-b257-4751-8b86-fa55b629c3f4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.386880 Jul 21 22:54:56.705993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 103/213] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:56 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:57.718230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:57.718916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:57.731054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:57.732204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:57.733110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:57.733695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:57.894829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:57.904897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-503a179f-d507-4fee-9606-bb9a501e5e79 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.194589 Jul 21 22:54:57.906271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 111/214] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:57 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:58.924202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:58.925847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:58.946725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:58.947324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:58.951892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:58.951892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:59.217850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:59.225980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ae480597-10d9-42a2-b438-686fa634ea4b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.308181 Jul 21 22:54:59.234115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 104/215] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:54:58 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:54:59.801014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-500701786", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be9945ce-a7e9-414b-b532-8c7c706d9d8c"}], "security_groups": [{"name": "tempest-securitygroup--787358432"}], "key_name": "tempest-keypair-670950779", "user_data": "}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:54:59.979141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] validate_networks() for [('be9945ce-a7e9-414b-b532-8c7c706d9d8c', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:55:00.250554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:00.251079 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:00.264289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.266591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.267770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.270897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.703749 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:00.717187 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b5675864-92b9-4d23-a0be-fb2481421005 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.471220 Jul 21 22:55:00.718744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 105/216] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:00 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:00.723052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:55:00.723712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:55:00.724609 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:55:00.725326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:55:00.726012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:55:00.755339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.758522 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.761180 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.761774 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.808615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:00.817839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:00.853706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:55:00.867242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:55:01.035276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-01e0512f-170c-4121-bb70-6194a8aba0e0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.238419 Jul 21 22:55:01.041677 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 112/217] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:54:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:55:01.049375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f589460e-1b95-4ada-902c-896016809ccd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:01.050204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f589460e-1b95-4ada-902c-896016809ccd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:01.305566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f589460e-1b95-4ada-902c-896016809ccd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:01.322600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f589460e-1b95-4ada-902c-896016809ccd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1240 microversion: 2.1 time: 0.278532 Jul 21 22:55:01.325246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 106/218] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:01 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1240 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:01.738603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:01.738603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:01.753870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:01.754337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:01.755194 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:01.755631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:02.045862 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:02.058380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-20c97199-e1c7-4660-95b0-c3e24ed3892a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.325674 Jul 21 22:55:02.067742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 113/219] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:01 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:02.347376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7eec53f9-8a10-463a-b82a-f8f42d49c852 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:02.349208 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7eec53f9-8a10-463a-b82a-f8f42d49c852 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:02.493635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7eec53f9-8a10-463a-b82a-f8f42d49c852 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:02.518425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7eec53f9-8a10-463a-b82a-f8f42d49c852 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1240 microversion: 2.1 time: 0.179866 Jul 21 22:55:02.520139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 107/220] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:02 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1240 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:03.082989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:03.082989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:03.095445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.097053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.098508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.098980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.309041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:03.321519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-86c1b77c-6e70-4a74-966b-b91166105ed2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1520 microversion: 2.1 time: 0.249543 Jul 21 22:55:03.324413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 114/221] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:03 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:03.536128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:03.536753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:03.550461 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.550977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.558070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.563807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.690997 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:03.713155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b45768fa-ab63-4a31-ae59-0c4268ef6501 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1244 microversion: 2.1 time: 0.181004 Jul 21 22:55:03.714016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 108/222] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:03 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1244 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:04.341894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:04.343089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:04.353875 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.354521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.356204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.356804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.588837 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:04.599476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d732a5ce-771a-41b4-aaa3-6b7d615673c6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1500 microversion: 2.1 time: 0.261627 Jul 21 22:55:04.616832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:04.617506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:04.623548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 115/223] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:04 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1500 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:04.630226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.631390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.632222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.632640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.730025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:04.730827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:04.743174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.743898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.762732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.763338 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.935302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:04.942059 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bdfa39ee-f1e3-4dce-8ad1-e57ad73077e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1514 microversion: 2.1 time: 0.328925 Jul 21 22:55:04.944771 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 109/224] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:04 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:05.117453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:05.147470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-598462e7-aa75-453d-8bf2-536ec4711f7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1292 microversion: 2.1 time: 0.421716 Jul 21 22:55:05.153080 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 116/225] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:04 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1292 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:06.167426 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:06.168037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:06.176869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:06.177317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:06.178126 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:06.179161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:06.328641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:06.337161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3c7f7cdb-e82e-4996-bb1d-f32a796a37ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1298 microversion: 2.1 time: 0.175787 Jul 21 22:55:06.337738 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 110/226] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:06 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:07.269829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:07.270878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:07.283611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.286720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.291031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.294078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.334871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lazy-loading 'flavor' on Instance uuid 0f21ad4b-325d-4945-91ee-58ed919e892c {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:55:07.508797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3ce6f5be-5bcb-43f3-b627-f69ca9a28ea9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Action: 'create', calling method: .version_select at 0x7fc5d76a3820>, body: {"keypair": {"name": "tempest-TestShelveInstance-354995666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzXjV+UOSQm0Z+hkpc7aC9Q954/rbEw2Gv1bdynm4Da3k26+YnlxrZyZ7D20ZB93lLfBNcKh/dFC95Q9tZqvPOHO3a6IGbxv20fI3hB/EOByiq95hBwFrmynNmeCIdlQ=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:07.530048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-3ce6f5be-5bcb-43f3-b627-f69ca9a28ea9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Getting quotas for project 93d60e3f3bcd48f292f30a8d2f0351d7. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:07.537253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-3ce6f5be-5bcb-43f3-b627-f69ca9a28ea9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Getting quotas for user a0a765202a9645a1acc332f559537458 and project 93d60e3f3bcd48f292f30a8d2f0351d7. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:07.652615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3ce6f5be-5bcb-43f3-b627-f69ca9a28ea9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.533448 Jul 21 22:55:07.653928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 117/227] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:55:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:07.661877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:07.663175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:07.670636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.671599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.672777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.673242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.851470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-789e1247-8b8b-4938-9a27-5a882f91e2f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/action" status: 200 len: 32 microversion: 2.1 time: 0.588205 Jul 21 22:55:07.856548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 111/228] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:55:07 2022] POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/action => generated 32 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:55:07.864605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:07.869432 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:07.883588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.885716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.895488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.896076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.944041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:07.953151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a7767347-55e9-45ed-a773-6f9c456573f0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.297228 Jul 21 22:55:07.955698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 118/229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:07 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:08.255723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:08.266939 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ea86d172-00b5-440f-bf49-8817e77e08f7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.407414 Jul 21 22:55:08.267764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 112/230] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:07 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:08.975985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:08.976924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:09.014970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.015743 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.018501 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.019563 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.259296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:09.271278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-02f9bdc3-ca37-47d3-a522-3157953a6b8a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.300464 Jul 21 22:55:09.271278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 119/231] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:08 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:09.285901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:09.289941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:09.296999 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.301876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.301876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.301876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.323498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:09.333493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-d65dd85c-a856-4a20-a0b7-17d1551d7e85 req-9761b75e-35df-4a2a-95e4-61660cfa64f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493bb0f1-8dde-4694-8e46-35e451a66b7a", "tag": "11031c16-fb45-409c-9526-c98d27b69652"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:09.343768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-d65dd85c-a856-4a20-a0b7-17d1551d7e85 req-9761b75e-35df-4a2a-95e4-61660cfa64f3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.344415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-d65dd85c-a856-4a20-a0b7-17d1551d7e85 req-9761b75e-35df-4a2a-95e4-61660cfa64f3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.370173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-d65dd85c-a856-4a20-a0b7-17d1551d7e85 req-9761b75e-35df-4a2a-95e4-61660cfa64f3 service nova] Creating event network-changed:11031c16-fb45-409c-9526-c98d27b69652 for instance 493bb0f1-8dde-4694-8e46-35e451a66b7a on hv-cinder-85069 Jul 21 22:55:09.370173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-d65dd85c-a856-4a20-a0b7-17d1551d7e85 req-9761b75e-35df-4a2a-95e4-61660cfa64f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039851 Jul 21 22:55:09.370173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 120/232] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:55:09.761187 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:09.776265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6749dc59-f4ed-4d1b-a3a7-90de404665c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.494410 Jul 21 22:55:09.776643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 113/233] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:09 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:09.914212 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:09.914815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:09.922089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.922548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.923351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.924031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.950700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4ff6b02f-73bb-4223-b4b1-c29be5cdab79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/ips" status: 200 len: 152 microversion: 2.20 time: 0.042410 Jul 21 22:55:09.951562 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 121/234] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jul 21 22:55:09 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:55:10.287329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:10.287931 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:10.305770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.309769 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:10.310738 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.313902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:10.434404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-520152515", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "networks": [{"uuid": "4023a2a0-6b6a-4e8b-9d74-f0c3f22b1520"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:10.541965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] validate_networks() for [('4023a2a0-6b6a-4e8b-9d74-f0c3f22b1520', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:55:10.551563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:10.560312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0d8ef7ff-3988-4452-8d14-b20a0fecbdfe tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.278640 Jul 21 22:55:10.560909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 114/235] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:10 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:10.781909 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:10.797191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:10.803493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:10.805137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.805588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:10.807644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.808282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.018135 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.027603 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d980027b-0fd1-495e-9f8b-ccf2622da264 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.234432 Jul 21 22:55:11.032631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 115/236] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:10 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:11.219817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:55:11.220243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:55:11.220911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:55:11.221315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:55:11.221718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:55:11.232056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.232554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.233342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.233766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.257805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Getting quotas for project 2822a8cb96b94bf3bf525b0785c36934. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:11.263481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Getting quotas for user 5eadb243fd6a4517bca72e18dec30e7a and project 2822a8cb96b94bf3bf525b0785c36934. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:11.281621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:55:11.281621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:55:11.527300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b72a47cf-2606-4e84-880a-4b04a7503c96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095579 Jul 21 22:55:11.532015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 122/237] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:55:11.544040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-de8bb69d-2347-4d6e-ad1b-bf25c5a1e676 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:11.546045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-de8bb69d-2347-4d6e-ad1b-bf25c5a1e676 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:11.586429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:11.586429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:11.604638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.605165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.615815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.615815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.655058 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-de8bb69d-2347-4d6e-ad1b-bf25c5a1e676 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.664862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-de8bb69d-2347-4d6e-ad1b-bf25c5a1e676 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1218 microversion: 2.1 time: 0.126524 Jul 21 22:55:11.675171 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 116/238] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:11 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:11.851868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.863486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-57849083-f8e1-4796-aae7-7725fe63ae87 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.287029 Jul 21 22:55:11.864423 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 123/239] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:11 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:12.048577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:12.048577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.054037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.054720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.055527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.055989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.228282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:12.237515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-97a8f742-c5fa-4c81-bf25-2460406e0df0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.196971 Jul 21 22:55:12.238818 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 117/240] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:12 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:12.487486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:12.488745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.502689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.503222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.504071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.504541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.535227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lazy-loading 'flavor' on Instance uuid 5f228a73-c5cf-494a-8440-c15567b7618b {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:55:12.567355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:12.567355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.572465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.572920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.573692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.574319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.760605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7302225d-e717-430f-af9e-73c0accf54f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/ips" status: 200 len: 147 microversion: 2.1 time: 0.199790 Jul 21 22:55:12.761172 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 118/241] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:55:12 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/ips => generated 147 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:55:12.765715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ffa53b70-7362-4e2c-ae61-18520cfdcd13 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:12.766173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ffa53b70-7362-4e2c-ae61-18520cfdcd13 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.825468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ffa53b70-7362-4e2c-ae61-18520cfdcd13 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:12.835334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ffa53b70-7362-4e2c-ae61-18520cfdcd13 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1218 microversion: 2.1 time: 0.072662 Jul 21 22:55:12.835916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 119/242] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:12 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:12.881852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:12.882515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.889488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.890225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.891209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.891909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.069554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.078321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-127dd9d5-08c5-45aa-a56e-934b98e6cf69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.201421 Jul 21 22:55:13.079930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 120/243] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:12 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:13.256224 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:13.256857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:13.263507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.264067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.265479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.266165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.349644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8450f4ed-e0f1-4bd1-97ff-d87edeb0123d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/action" status: 202 len: 0 microversion: 2.20 time: 0.865350 Jul 21 22:55:13.350335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 124/244] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 21 22:55:12 2022] POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:55:13.369401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:13.370202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:13.380899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.381894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.382992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.383586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.460628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.469036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2adbc3db-3140-4dc3-ac0f-eee0f9caa627 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.217052 Jul 21 22:55:13.469739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 121/245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:13 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:13.531302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.540313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.542192 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.543452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0debe5ee-e235-4ab9-88ea-bdb331fa7dd8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.187334 Jul 21 22:55:13.544720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 125/246] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:13 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:13.854038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:13.854720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:13.869694 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.870148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.871001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.871484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.938242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.946455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-801fc105-ed4e-43d1-8f1c-da3f79046e8e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1270 microversion: 2.1 time: 0.097469 Jul 21 22:55:13.947051 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 122/247] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:13 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:14.097685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:14.098331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:14.105217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.105910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.106693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.107162 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.287629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.291210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:14.296367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d9c56f1b-b4ce-46d8-a79b-adf2efe85dee tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.203328 Jul 21 22:55:14.299188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 126/248] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:14 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:14.508296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:14.510741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:14.520537 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.520995 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.521779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.522219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.570892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:14.572261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:14.579254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.579989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.581189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.582307 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.762625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.763033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.772610 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.786291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.786291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a68cf584-76e0-46ed-bef1-303daecc6c3b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.216757 Jul 21 22:55:14.786291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 127/249] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:14 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:14.792246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-56b8d89b-dc05-4faf-a709-34a668887a65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.306551 Jul 21 22:55:14.792844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 123/250] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:14 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:14.963987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:14.970326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:14.977954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.985393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.987256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.987862 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.076091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.092907 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-040d64eb-20f9-4c3a-b59f-f76bab4c7984 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1288 microversion: 2.1 time: 0.133095 Jul 21 22:55:15.095414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 128/251] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:14 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1288 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:15.313448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.314046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.322734 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.323224 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.323992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.324450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.637130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5051eb90-bedb-4d1c-ae57-607bac1373d8"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:15.639115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.662104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.662104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.662104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.662104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.927937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.927937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a094b024-72a1-4f60-a9dd-67787dd6f1a3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.617762 Jul 21 22:55:15.928357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 124/252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:15 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:15.933169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.933767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.943024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.943631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.944697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.945298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.266234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.275088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.276879 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.278284 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ae1869cb-3613-400f-a04f-53a81bc4daf5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.348777 Jul 21 22:55:16.278878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 125/253] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:15 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:16.295509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.295868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.303158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.303832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.304784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.504327 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.512301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-79c4b73d-ed72-4cb9-83f4-c0998edeb87f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.221253 Jul 21 22:55:16.512964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 126/254] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:16.522909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.523516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.529530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.529986 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.530753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.531277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.613354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cb674cb3-647f-4f62-b9a8-cdf8823a91cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981411 Jul 21 22:55:16.618079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 129/255] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:55:15 2022] POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:55:16.683631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.691053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ee576222-a479-4eba-a44e-c0449e5eee71 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.176941 Jul 21 22:55:16.692040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 127/256] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:16.946111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.946880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.954053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.954505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.955314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.955977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.096303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.104314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-340bf17f-a559-4607-8bd6-6d8b310afcd6 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.163262 Jul 21 22:55:17.104895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 130/257] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:17.297323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:17.297930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:17.304726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.305179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.305943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.306379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.432781 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.440685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.442199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.443390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a03f8e46-363b-409d-9cc8-e11314e9cab3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.150282 Jul 21 22:55:17.443954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 128/258] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:17 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:17.529451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:17.530107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:17.537018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.537461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.538639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.539109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.664017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.671409 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-601971d1-f9cb-4b8b-91ec-db787d8183e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.145908 Jul 21 22:55:17.671976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 131/259] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:17 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:17.708154 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:17.708767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:17.715002 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.715457 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.716488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.716924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.847381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:17.855509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-55baccbc-7365-4fdb-928b-9f8e8e7a023f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.151636 Jul 21 22:55:17.856082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 129/260] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:17 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:18.121292 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:18.122008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:18.129123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.129580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.130329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.130756 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.257447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.264940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-33756f51-3c0a-421d-9de0-f3ef1ff434e3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.147509 Jul 21 22:55:18.265505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 132/261] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:18 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:18.461482 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:18.462092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:18.468784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.469236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.470000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.470448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.600045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.608113 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.609628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.610795 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c5241a53-3c01-47b6-a5fb-3f479d893a16 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.153263 Jul 21 22:55:18.611381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 130/262] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:18 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:18.688418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:18.689017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:18.695128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.695580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.696345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.696830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.829864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.837822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-56a36891-8c1e-4006-b4df-c01df609b812 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.153303 Jul 21 22:55:18.838386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 133/263] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:18 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:18.872051 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:18.872659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:18.878796 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.879582 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.880359 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.880800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.079926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.086402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e17ab59f-4d03-4b0d-b0f9-4e522a1ad14e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.218035 Jul 21 22:55:19.087206 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 131/264] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:18 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:19.281937 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.282984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.287458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:19.295143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.295886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.297140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.297734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.435016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-fa442bbf-da2b-432f-9519-ae840d6ff472 req-358e63d5-f58b-4b7d-a2e0-9b7c310070bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493bb0f1-8dde-4694-8e46-35e451a66b7a", "name": "network-vif-plugged", "status": "completed", "tag": "11031c16-fb45-409c-9526-c98d27b69652"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:19.439346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=76 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:19.448641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-fa442bbf-da2b-432f-9519-ae840d6ff472 req-358e63d5-f58b-4b7d-a2e0-9b7c310070bb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.449413 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-fa442bbf-da2b-432f-9519-ae840d6ff472 req-358e63d5-f58b-4b7d-a2e0-9b7c310070bb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.452524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:19.465506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-fa442bbf-da2b-432f-9519-ae840d6ff472 req-358e63d5-f58b-4b7d-a2e0-9b7c310070bb service nova] Creating event network-vif-plugged:11031c16-fb45-409c-9526-c98d27b69652 for instance 493bb0f1-8dde-4694-8e46-35e451a66b7a on hv-cinder-85069 Jul 21 22:55:19.475527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-fa442bbf-da2b-432f-9519-ae840d6ff472 req-358e63d5-f58b-4b7d-a2e0-9b7c310070bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044090 Jul 21 22:55:19.477089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 132/265] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:19.630947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.632224 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.640338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.641040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.641864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.642447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.677468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.687251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bd6771a0-b884-4db1-b1e4-e55bf5842616 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.409045 Jul 21 22:55:19.687888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 134/266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:19.856397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.857036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.857649 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.863386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.863836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.864615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.865039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.865763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.867306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.868486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f41b3adc-198d-4383-a3bf-1d11db91cb97 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.242495 Jul 21 22:55:19.869023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 133/267] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:19.980329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-6b632f36-551b-4af0-b5ac-beaef6895a58 req-a87d8d52-7138-418d-8887-42f77e61b69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294aeb91-ca3e-45e1-af6f-efe768e62fff", "tag": "7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:20.001927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6b632f36-551b-4af0-b5ac-beaef6895a58 req-a87d8d52-7138-418d-8887-42f77e61b69f service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.002370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6b632f36-551b-4af0-b5ac-beaef6895a58 req-a87d8d52-7138-418d-8887-42f77e61b69f service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.017365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-6b632f36-551b-4af0-b5ac-beaef6895a58 req-a87d8d52-7138-418d-8887-42f77e61b69f service nova] Creating event network-changed:7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739 for instance 294aeb91-ca3e-45e1-af6f-efe768e62fff on hv-cinder-85069 Jul 21 22:55:20.023803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-6b632f36-551b-4af0-b5ac-beaef6895a58 req-a87d8d52-7138-418d-8887-42f77e61b69f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050631 Jul 21 22:55:20.024726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 134/268] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:20.045016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.054155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-465282fb-da64-4dbe-8b95-537025293e63 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.201959 Jul 21 22:55:20.065942 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 135/269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:20.103636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.104363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.115842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.115842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.115842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.115842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.325936 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.334012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0e9928b4-262f-460d-9e90-4f9886f34e96 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.235108 Jul 21 22:55:20.334586 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 135/270] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:20.706997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.707759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.714413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.714903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.715717 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.716402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.858843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.866510 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0ff0cfd1-e500-45d7-b7d2-dd9940cdf02e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.164027 Jul 21 22:55:20.871139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 136/271] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:20.886117 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.886897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.894029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.894494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.895290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.895728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.031177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.039288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.040878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.042029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4b2114b7-a9b2-4687-b1f3-0499171b453f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.159884 Jul 21 22:55:21.042661 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 136/272] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:21.072215 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.072821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.079092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.079546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.080313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.080838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.221965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.229854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dd3529df-8421-4af3-a747-3acbfed9baa6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.161530 Jul 21 22:55:21.230625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 137/273] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:21.351823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.352434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.358371 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.358831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.359649 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.360054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.490825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.498969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c3011988-84cc-41ea-8fe7-098c6052f8d9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.150462 Jul 21 22:55:21.498969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 137/274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:21.886039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.886674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.888646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=20 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:21.889333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:21.894573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.895055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.895811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.896240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.028569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.035989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3c9ed22f-d972-4213-a5a2-c580742723c2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.153799 Jul 21 22:55:22.036549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 138/275] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:22.060321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.060892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.067982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.068428 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.069188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.069622 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.196365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.204400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.205962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.207189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6de57781-901e-4711-bec2-9d5088303d9e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.150737 Jul 21 22:55:22.207745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 138/276] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:22.247746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.248342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.254403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.254872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.255645 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.256070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.387190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.394661 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5202517e-83b9-40de-add7-50797b43b422 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.150829 Jul 21 22:55:22.395252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 139/277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:22.515876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.516478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.522658 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.523154 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.523907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.524338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.652930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.661044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9f0b71ca-6ae1-4d33-b564-fb79b5e9f599 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.148996 Jul 21 22:55:22.661610 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 139/278] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:23.052777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.053382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.059899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.060350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.061111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.061545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.191264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.198838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-17144fc1-9423-4288-a47e-6f6cc3085b07 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.149926 Jul 21 22:55:23.199409 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 140/279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:23.225669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.226265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.228200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=8 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:23.233530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.234047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.234816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.235248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.364151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.372100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.373655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.374838 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1ab0dea7-63c2-41aa-9926-6ab71d8c7795 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.153214 Jul 21 22:55:23.375405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 140/280] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:23.412089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.412650 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.420528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.420975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.422564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.423028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.550731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.558141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2951faaf-79b1-4cc9-a22c-a2514f2e6da1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.149980 Jul 21 22:55:23.558710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 141/281] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:23.677914 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.678439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.684339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.684784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.686495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.686495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.816159 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.823423 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cb824b50-08e8-4014-ab51-bc089a8cf7f7 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.149955 Jul 21 22:55:23.824010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 141/282] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:24.216442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.217045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.223718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.224165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.224931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.225358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.229282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:24.358986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.371412 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-09e0c989-2536-487f-9234-f460fa83ce7d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.159088 Jul 21 22:55:24.371986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 142/283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:24.396004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.396673 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.403840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.404285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.405068 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.405638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.539073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.546966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.548486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.549642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-01c3ada7-1852-4b90-9c38-3d2baa546d0d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.159593 Jul 21 22:55:24.553420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 142/284] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:24.575583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.576193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.582553 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.583040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.583804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.584240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.713637 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.722376 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-82ef8c28-bc9e-4e75-95ec-f13a375d176d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.150569 Jul 21 22:55:24.722984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 143/285] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:24.841530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.842144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.848215 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.848661 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.849422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.849855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.985655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:24.994290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9daed022-f45e-4534-92a4-16fab8fc8563 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.156828 Jul 21 22:55:24.995010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 143/286] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:25.393405 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:25.394046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:25.400554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.401208 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.401969 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.402399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.554275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.561936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f4531663-ca37-4dc1-9032-757c3c5cc0e5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1365 microversion: 2.1 time: 0.172623 Jul 21 22:55:25.571493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 144/287] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:25 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:25.571697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:25.571697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:25.575398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.575845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.577477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.577477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.732520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.740287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:25.740890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:25.741350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.743091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.744888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2deaa7c2-1a8e-4f31-b039-7ea872fbae53 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.180400 Jul 21 22:55:25.747164 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.747606 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.748366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.748794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.755524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 144/288] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:25 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:25.893730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.901512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3df01e60-f9c5-48c4-8f98-467c5dc6168e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.165529 Jul 21 22:55:25.902086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 145/289] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:25 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:26.012404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.013012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.019483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.020066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.021105 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.021689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.156401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.165222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fc042e15-d84b-4361-9794-b6c622c1df44 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.157045 Jul 21 22:55:26.165789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 145/290] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:26.579302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.579911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.591539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.591539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.591539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.591539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.719396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.727599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1e6b5c11-1096-4a54-8385-fd30a6e91a0d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1556 microversion: 2.1 time: 0.152169 Jul 21 22:55:26.728355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 146/291] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:26.745062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.745786 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.763742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.764021 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.764726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.765125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.767689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.769206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.802649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.802649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.802649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.802649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.845391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9d064489-6875-4ce6-bd49-8f46ddefd8a4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105266 Jul 21 22:55:26.846182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 146/292] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:26.919744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.920357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.927842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.928411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.929399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.930004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.940668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.949119 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.950750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.952139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-97f315c5-3c0a-41fc-814f-13517f01c460 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.192285 Jul 21 22:55:26.954822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 147/293] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:27.180926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.196351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:27.197111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:27.219374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f882a317-b3b9-453b-8c2a-a780536e284d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.300818 Jul 21 22:55:27.220839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 147/294] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:27.221257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.221916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.223467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.224100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.382193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.391719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c91b438c-12d5-4a3b-a84f-ede43ab75d75 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.204115 Jul 21 22:55:27.393199 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 148/295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:27 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:27.970840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:27.971450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:27.978767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.979243 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.980006 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.980441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.210888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.219691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.221263 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.223043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b7d3d47b-c5e9-4704-b222-a1dc90f99484 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.256581 Jul 21 22:55:28.223605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 148/296] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:27 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:28.236098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:28.237216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:28.243818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.244460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.245017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.245622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.272089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-c4621e34-5c5e-46b3-8dfa-2a9c8c28d0e0 req-423b7149-c27b-4eb0-b590-848784904d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493bb0f1-8dde-4694-8e46-35e451a66b7a", "tag": "11031c16-fb45-409c-9526-c98d27b69652"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:28.283399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c4621e34-5c5e-46b3-8dfa-2a9c8c28d0e0 req-423b7149-c27b-4eb0-b590-848784904d8a service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.290971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c4621e34-5c5e-46b3-8dfa-2a9c8c28d0e0 req-423b7149-c27b-4eb0-b590-848784904d8a service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.295458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-c4621e34-5c5e-46b3-8dfa-2a9c8c28d0e0 req-423b7149-c27b-4eb0-b590-848784904d8a service nova] Creating event network-changed:11031c16-fb45-409c-9526-c98d27b69652 for instance 493bb0f1-8dde-4694-8e46-35e451a66b7a on hv-cinder-85069 Jul 21 22:55:28.304859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-c4621e34-5c5e-46b3-8dfa-2a9c8c28d0e0 req-423b7149-c27b-4eb0-b590-848784904d8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037061 Jul 21 22:55:28.305681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 149/297] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:55:28.401868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.410049 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:28.410749 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:28.417483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.417937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.418654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ba7419b2-e04b-414d-bf92-2dc51361c49a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.186784 Jul 21 22:55:28.418811 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.428222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.428401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 149/298] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:28 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:28.556490 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.563922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9c0ceb1f-a5f9-4f2c-8e96-9b3865bafe55 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.158063 Jul 21 22:55:28.564499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 150/299] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:28 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:29.249871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.251374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.258354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.258850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.259694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.260121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.424641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.434544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.436090 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.437716 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b0098d97-b16f-401a-a876-923f388f1037 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.191866 Jul 21 22:55:29.438270 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 150/300] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:29.438521 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.439248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.446611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.447091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.447865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.448302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.450998 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:29.581188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.581188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.585665 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.587369 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.587815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.588581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.589011 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.593611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6771922a-a3df-4bea-b1bf-34358e7c2d29 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.160915 Jul 21 22:55:29.594395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 151/301] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:29.719574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.727482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f97a83d0-d1b6-4fbf-9932-84d2f91ae0c0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.150784 Jul 21 22:55:29.728039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 151/302] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:30.456770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.457551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.464246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.464711 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.465480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.465905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.557403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9dd1fd42-11ad-42b3-8493-b009eb1d51bf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:30.564278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9dd1fd42-11ad-42b3-8493-b009eb1d51bf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.564836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9dd1fd42-11ad-42b3-8493-b009eb1d51bf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.631424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9dd1fd42-11ad-42b3-8493-b009eb1d51bf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Going to try to stop instance {{(pid=124925) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 22:55:30.678767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.682271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.683887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.685184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-80d4ca73-3fed-47fc-bdb5-9978acac9203 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.232493 Jul 21 22:55:30.685844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 152/303] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:30.699137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.699926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.708048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.709008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.709844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.710353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.825010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9dd1fd42-11ad-42b3-8493-b009eb1d51bf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action" status: 202 len: 0 microversion: 2.1 time: 0.271932 Jul 21 22:55:30.835487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 152/304] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:55:30 2022] POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:55:30.835487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.835487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.839781 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.840230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.841000 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.841686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.888614 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.897311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8aaee92f-9fb2-40df-b29c-9de02cbeb93b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.201810 Jul 21 22:55:30.902811 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 153/305] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:30.907517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.908335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.916578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.917143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.918062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.918590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.985441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.993533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-54c60c91-fcbe-4205-9236-c5fc81048787 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.166813 Jul 21 22:55:30.994101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 153/306] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:31.056147 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.064106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-33ad2809-7230-4c96-875f-4a8ec9446043 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.165287 Jul 21 22:55:31.064679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 154/307] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:31.703760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:31.704352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:31.711355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.711797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.712593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.713056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.841802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.850262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.851755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.852896 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3d6899c8-adfc-4934-8d0b-af9bfdd37c5b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.153112 Jul 21 22:55:31.853438 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 154/308] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:31 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:31.923665 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:31.924232 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:31.930979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.931504 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.932331 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.932822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.012078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:32.012678 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:32.018667 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.019156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.020484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.020912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.148746 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.157295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7c77dc48-680d-4d43-8f2a-ecb6b5edea66 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.247588 Jul 21 22:55:32.157881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 155/309] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:31 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:32.159721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.162505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:32.163160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:32.170254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.170709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.171315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4766ae87-8159-4474-b7fd-1cc26a203322 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.163182 Jul 21 22:55:32.180640 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 155/310] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:32 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:32.183642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.183642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.453520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.474670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3b40268e-d1c2-49be-8dc2-4fd6154a1adf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.315669 Jul 21 22:55:32.475314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 156/311] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:32 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:32.823030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-1f6f7e7a-7ac9-4cf5-910a-55bcb6d6bffc req-3c667cc3-1980-4c73-9d72-eaf5ab8be8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294aeb91-ca3e-45e1-af6f-efe768e62fff", "name": "network-vif-plugged", "status": "completed", "tag": "7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:32.833522 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-1f6f7e7a-7ac9-4cf5-910a-55bcb6d6bffc req-3c667cc3-1980-4c73-9d72-eaf5ab8be8d0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.836801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-1f6f7e7a-7ac9-4cf5-910a-55bcb6d6bffc req-3c667cc3-1980-4c73-9d72-eaf5ab8be8d0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.845709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-1f6f7e7a-7ac9-4cf5-910a-55bcb6d6bffc req-3c667cc3-1980-4c73-9d72-eaf5ab8be8d0 service nova] Creating event network-vif-plugged:7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739 for instance 294aeb91-ca3e-45e1-af6f-efe768e62fff on hv-cinder-85069 Jul 21 22:55:32.850687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-1f6f7e7a-7ac9-4cf5-910a-55bcb6d6bffc req-3c667cc3-1980-4c73-9d72-eaf5ab8be8d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032026 Jul 21 22:55:32.851364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 156/312] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:32.871757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:32.872367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:32.879701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.880153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.880921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.881373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.015036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.022984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.024489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.025643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d5f63fb4-0e0e-4674-81f5-513a689b889c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.158711 Jul 21 22:55:33.026204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 157/313] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:32 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:33.175237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.176128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.182371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.182924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.183709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.184148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.188238 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.188879 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.195073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.195528 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.196295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.196752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.315712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.323431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-60bd1133-c147-4499-8342-cb4135374fa2 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.152349 Jul 21 22:55:33.323907 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 157/314] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:33.334588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.342311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3d9c992c-fd51-4e32-a51d-0ae38700a90b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.157973 Jul 21 22:55:33.342894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 158/315] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:33.492425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.492944 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.499031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.499473 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.500248 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.500674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.518164 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:33.626574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.634334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c1090a9f-1448-4459-a950-1cf30c5820ab tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.146524 Jul 21 22:55:33.634914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 158/316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:34.044252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.044850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.051406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.051849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.052598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.053026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.184766 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.193434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.194962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.196104 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7361e646-7459-4dab-b10c-7df70c92b9cc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.155801 Jul 21 22:55:34.196726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 159/317] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:34.341421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.342388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.349259 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.349705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.350470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.350930 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.359416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.360019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.365917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.366357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.367290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.367901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.487375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.495744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.499961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4fc6add3-e358-4e03-8118-cb067887ca0a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.162851 Jul 21 22:55:34.500616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 159/318] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:34.503612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3667d92d-6411-4157-aca0-300358ed4785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.147886 Jul 21 22:55:34.508645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 160/319] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:34.652394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.652996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.658972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.659418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.660176 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.660604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.788465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.796344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9e9bb784-bbff-4d1b-bfa4-ca102acd5bd9 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.147798 Jul 21 22:55:34.797095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 160/320] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:35.214298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.214833 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.221667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.222117 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.223585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.224023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.354430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.362348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.363952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.365103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ca286dd3-3b54-4267-b773-7aac6e5c1e7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.154786 Jul 21 22:55:35.365663 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 161/321] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:35.517402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.518001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.521149 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.521762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.525236 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.525679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.526435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.526890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.527644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.528100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.528859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.529294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.658695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.658913 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.666864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4e1a35d3-09fd-45b6-8e40-72167efad623 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.153314 Jul 21 22:55:35.667007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4168632a-15ae-43f9-ad18-6c99f38a2d59 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.149979 Jul 21 22:55:35.667696 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 162/323] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:35.667811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 161/323] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:35.813095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.813723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.820161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.820619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.821350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.821783 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.947137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.954945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f19aa47c-028c-4520-8e55-6e9a2f42d457 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.145598 Jul 21 22:55:35.955509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 163/324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:36.384375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.384977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.391036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.391481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.392239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.392720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.525057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.532899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.534437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.536135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-18186e43-b224-40b7-94bd-f0748ec23729 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.155770 Jul 21 22:55:36.536689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 162/325] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:36.683139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.683612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.683745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.685847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.690519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.691019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.691843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.692278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.692411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.692734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.693535 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.693975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.828386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.833786 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.836728 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a536858-84d1-4b50-b502-9572ed331dbc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.156889 Jul 21 22:55:36.837528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 163/326] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:36.841318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-84f63c1c-3f3e-4ec5-be0a-68e68e125dbb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.162046 Jul 21 22:55:36.842128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 164/327] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:36.973422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.974029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.980063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.980506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.981273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.981701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.112426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.120765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-079a2cb1-b293-45a7-8305-60bbbd7aa53c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.151933 Jul 21 22:55:37.121339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 164/328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:37.553592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:37.554120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:37.560974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.561417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.562219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.562650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.697671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.705536 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.707069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.708207 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bcd96a35-f2a8-4edd-a2c2-0df993f19481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.158656 Jul 21 22:55:37.708757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 165/329] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:37 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:37.853320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:37.853935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:37.858897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:37.859164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:37.860448 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.860902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.861680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.862116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.865655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.866159 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.867044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.867540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.998854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.009945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5325fbf4-77c5-47d0-9fbe-b0e5b458d33a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1500 microversion: 2.1 time: 0.160397 Jul 21 22:55:38.012099 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.014293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 165/330] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:37 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:38.023600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9f113f85-7e5f-456c-9c98-9351f252c69f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.168864 Jul 21 22:55:38.024317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 166/331] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:37 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:38.026974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0b6ad43-892a-4531-bc6f-6289e56b8ac4"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:38.028671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.036222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.036677 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.037447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.037928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.060970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f21ad4b-325d-4945-91ee-58ed919e892c while it is in vm_state rescued Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Request method failure captured: Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/os-volume_attachments HTTP/1.1 Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 74 Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djl5ylwvFwuVrwvAAx1miTGYbgUP0wxjDzIWQN_wotuovo_JjFSah6fPcyhqCTGKTnRinb0zYPJccMuNINNRm8OspiSPFukoU_9DFcd3MoPFKL0e2ofx90ja16Qblzqmg7Kg6XXKSVHpT0GN_dnqS5DzkOZulWWKQ0zzbfBHmieH9g Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:55:38.062591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_755a70c4912f4795ae67cf9f036e02aa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 4947466838974a71815561640fa55c14 Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {"volumeAttachment": {"volumeId": "a0b6ad43-892a-4531-bc6f-6289e56b8ac4"}} Jul 21 22:55:38.063960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Cannot 'attach_volume' instance 0f21ad4b-325d-4945-91ee-58ed919e892c while it is in vm_state rescued Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'server_id': '0f21ad4b-325d-4945-91ee-58ed919e892c', 'body': {'volumeAttachment': {'volumeId': 'a0b6ad43-892a-4531-bc6f-6289e56b8ac4'}}} Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:55:38.064847 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f21ad4b-325d-4945-91ee-58ed919e892c while it is in vm_state rescued Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:55:38.066225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f21ad4b-325d-4945-91ee-58ed919e892c while it is in vm_state rescued Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Returning 409 to user: Cannot 'attach_volume' instance 0f21ad4b-325d-4945-91ee-58ed919e892c while it is in vm_state rescued {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f07ace55-cdc7-4f33-8164-c791d71ff928 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041470 Jul 21 22:55:38.067625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 166/332] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:55:38 2022] POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:55:38.073263 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:38.073903 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.082763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.082763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.082763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.082763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.109127 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:38.137863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:38.138477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.144629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.145083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.145855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.146296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.277336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.285939 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9be859b5-7184-4fe3-aeec-6a79efb98491 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.151625 Jul 21 22:55:38.286561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 167/333] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:38 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:38.321534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-004c8c6d-1fbf-4214-a10f-553da8ad0fe0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/action" status: 202 len: 0 microversion: 2.1 time: 0.251966 Jul 21 22:55:38.322088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 167/334] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:55:38 2022] POST /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:55:38.332716 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:38.333333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.339350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.339799 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.340621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.341064 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.471256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.479777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a0485b6c-d47e-4e48-b078-5e57d1b695c5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.151432 Jul 21 22:55:38.483952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 168/335] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:38 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:38.727796 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:38.728489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.734712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.735200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.735976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.736415 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.871311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.880769 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.882291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.883484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3070c2a9-a47c-4413-83d3-f1e197750a4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.160610 Jul 21 22:55:38.884038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 168/336] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:38 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:39.040099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.040727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.047359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.047813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.048586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.049026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.199256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2054406151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-354995666", "security_groups": [{"name": "tempest-secgroup-smoke-1108050036"}], "networks": [{"uuid": "cd677390-a761-421a-b07f-23baca7a5af3"}], "block_device_mapping_v2": [{"uuid": "207cca72-28e7-47b4-9181-c3728dd03db5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:39.234878 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.242979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-975eb4ff-a0af-44c6-8573-20b0853830cb tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.206878 Jul 21 22:55:39.243551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 169/337] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:39.303697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.304300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.311042 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.311492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.312262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.312695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.377954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] validate_networks() for [('cd677390-a761-421a-b07f-23baca7a5af3', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:55:39.462638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.471503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d37fe78b-c841-4594-b5b2-7105caadc894 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.172302 Jul 21 22:55:39.472084 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 170/338] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:39.498926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.499855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.506358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.506829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.507601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.508039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.641035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.649145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a51604e9-fd52-43cf-9317-90505c28e0ff tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.154373 Jul 21 22:55:39.659073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 171/339] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:39.809469 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:55:39.809955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:55:39.811148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:55:39.811148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:55:39.811351 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:55:39.822103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.822554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.823390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.823825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.841323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Getting quotas for project 93d60e3f3bcd48f292f30a8d2f0351d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:39.845775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Getting quotas for user a0a765202a9645a1acc332f559537458 and project 93d60e3f3bcd48f292f30a8d2f0351d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:39.902088 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.902686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.903723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:55:39.905890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='207cca72-28e7-47b4-9181-c3728dd03db5',volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:55:39.908694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.909141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.909932 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.910382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.042438 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.051827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.053324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.054468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fab11015-1441-4e87-a213-73c793c07bba tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.156565 Jul 21 22:55:40.055043 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 172/340] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:40.261332 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.261936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.268099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.268550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.269314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.269758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.304321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-70d37303-31fc-42dd-98c3-4b5ba31cb8ed tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.109103 Jul 21 22:55:40.310188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 169/341] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:55:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:55:40.325299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-876d7431-f537-40ab-8507-0ec1eb632a61 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.325919 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-876d7431-f537-40ab-8507-0ec1eb632a61 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.381480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-876d7431-f537-40ab-8507-0ec1eb632a61 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.391124 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-876d7431-f537-40ab-8507-0ec1eb632a61 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1088 microversion: 2.1 time: 0.076943 Jul 21 22:55:40.391124 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 170/342] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:40.422462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.430827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a1c34d80-360a-47b8-b6bd-952143d9421e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1318 microversion: 2.1 time: 0.173389 Jul 21 22:55:40.431404 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 173/343] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:40.490246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.490949 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.497069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.497509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.498265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.498718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.628759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.636708 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-93cdcfbc-7e81-4eca-b264-b1088097e312 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.151177 Jul 21 22:55:40.637274 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 171/344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:40.666848 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.667450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.673630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.674023 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.674796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.675235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.809459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.817087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-451c7cdd-4666-4158-96a4-ab70691e2f54 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.154065 Jul 21 22:55:40.817654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 174/345] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:41.072629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.073236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.079718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.080162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.082655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.083140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.214291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.222394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.223977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.225052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-46c39337-e2f4-463b-9b5f-3fe392571d67 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.156342 Jul 21 22:55:41.225600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 172/346] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:41.406291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.406875 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.413399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.413849 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.414609 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.415089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.433751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:41.449441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.450053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.452080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:41.456847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.457350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.458122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.458552 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.476995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.485303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e5c6f1ab-fabc-4989-be68-48048aa1f856 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1138 microversion: 2.1 time: 0.082829 Jul 21 22:55:41.485987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 175/347] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:41.586688 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.594393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-16e90764-f4ae-4814-8553-d41949dbf320 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1507 microversion: 2.1 time: 0.148753 Jul 21 22:55:41.594989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 173/348] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:41.653565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.654173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.660244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.660675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.661449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.661884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.792889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.800760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8a4a12e7-d3e0-47e2-bd68-2b2dcf6756d0 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.151320 Jul 21 22:55:41.801854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 176/349] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:41.833541 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.837540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.840194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.840647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.841410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.841845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.975374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.983098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-05e17e02-735c-48d5-a450-2e73637c2e7a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.153366 Jul 21 22:55:41.983602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 174/350] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:42.243858 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.244455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.250484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.250969 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.251756 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.252184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.391656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.399577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.401081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.402216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2495a8e6-cd7d-4a7f-b95f-8c8ee36dcb4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.162496 Jul 21 22:55:42.402787 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 177/351] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:42.502514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.503146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.509742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.510192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.510993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.511427 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.572031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.579384 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ec834b4b-d77b-4c41-9727-3b54ae81315d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1138 microversion: 2.1 time: 0.080808 Jul 21 22:55:42.579946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 175/352] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:42.818200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.818741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.826163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.826614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.827422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.827854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.958211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.966273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-60e3fc0c-ce9b-42e5-a8bd-7398d60d3a4d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.152023 Jul 21 22:55:42.966862 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 178/353] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:43.000330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.000938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.007121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.007558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.008331 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.008767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.055759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-bb4a097a-547c-4265-9631-a5978e439b4c req-5ed21c4b-45dd-4f10-82a2-22a45eb5c4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "name": "network-vif-plugged", "status": "completed", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:43.063806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-bb4a097a-547c-4265-9631-a5978e439b4c req-5ed21c4b-45dd-4f10-82a2-22a45eb5c4e9 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.064253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-bb4a097a-547c-4265-9631-a5978e439b4c req-5ed21c4b-45dd-4f10-82a2-22a45eb5c4e9 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.076224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-bb4a097a-547c-4265-9631-a5978e439b4c req-5ed21c4b-45dd-4f10-82a2-22a45eb5c4e9 service nova] Creating event network-vif-plugged:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:55:43.081267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-bb4a097a-547c-4265-9631-a5978e439b4c req-5ed21c4b-45dd-4f10-82a2-22a45eb5c4e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029175 Jul 21 22:55:43.081869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 179/354] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:43.140011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.148074 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7686bee8-059f-4487-aa28-7f0cdadf74fa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.151634 Jul 21 22:55:43.148638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 176/355] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:43.421282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.421980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.428286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.428738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.429496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.429934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.596510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.597404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.605277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.605725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.606512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.606990 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.671122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.678910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-101c29ab-70d0-4216-a86d-54c21d25d9c6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1138 microversion: 2.1 time: 0.086450 Jul 21 22:55:43.679501 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 177/356] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:43.775321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.783108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.784663 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.786566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a1973e2f-f9e8-4660-bf3b-00a22dac8246 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1745 microversion: 2.20 time: 0.369786 Jul 21 22:55:43.787238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 180/357] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:43.983309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.983902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.990018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.990464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.991257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.991692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.165421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:44.166020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:44.173232 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.173709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.174505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.174991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.185418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.194355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b3569f34-1d31-4cd3-9910-bac76c5631d1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.214782 Jul 21 22:55:44.194967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 178/358] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:44.321908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.330091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9d0b1378-d58b-4a95-8b04-70ee1add73d1 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.168617 Jul 21 22:55:44.330813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 181/359] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:44 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:44.696554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:44.697115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:44.705849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.706295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.707419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.707973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.769383 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.776924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-05511e63-7ca3-41a9-b6ef-3fd9621290c8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1186 microversion: 2.1 time: 0.084391 Jul 21 22:55:44.777520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 179/360] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:44 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:44.805281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:44.805888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:44.812023 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.812466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.813222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.813655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.948076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.955989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.957498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.958655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b760dc72-90d6-4ab0-8a54-9a965e9c6d31 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.157948 Jul 21 22:55:44.959245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 182/361] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:44 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:45.217858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:45.217858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:45.219459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.219915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.220684 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.221122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.348924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:45.350957 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:45.356661 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.357436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.357876 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.358640 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.359088 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.364808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e0d3ea39-130d-4c0c-bf5b-9987c7a0fbe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.157201 Jul 21 22:55:45.365390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 180/362] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:45 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:45.490948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.499361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-047be9dc-e327-4fb6-8922-b477acb816b5 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.154346 Jul 21 22:55:45.499939 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 183/363] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:45 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:45.796644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:45.797244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:45.805062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.805632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.806414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.806854 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.873480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.881548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-68f3acb5-1c55-44e9-b073-f85c0a1d8ec8 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1186 microversion: 2.1 time: 0.089849 Jul 21 22:55:45.882118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 181/364] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:45 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:45.979274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:45.979930 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:45.982072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:45.987103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.987607 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.988444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.988876 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.118249 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.127027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.133016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.133016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dd2f3445-9e01-46f7-b8ef-09d3d9b0cdb0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.154708 Jul 21 22:55:46.133016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 184/365] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:45 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:46.382178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.382810 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.389042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.389529 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.390291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.390962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.519532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.520143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.527778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.528218 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.528991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.529422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.530222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.538445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-60697e21-86d5-4d5d-a250-d4fd4b2fb248 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.160724 Jul 21 22:55:46.539539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 182/366] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:46.682190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.691798 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bbbfbee9-d469-4bc6-a509-c3fd372db89e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.174947 Jul 21 22:55:46.692429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 185/367] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:46.897763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.898498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.905951 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.909942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.909942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.909942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.972458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.980759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-54dfa641-d1b5-4940-9a0b-0d0a60dd9e9f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1194 microversion: 2.1 time: 0.087174 Jul 21 22:55:46.981447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 183/368] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:47.149325 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.149961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.156568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.157071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.157834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.158269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.291455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.299564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.303440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.303440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7f12ac91-13aa-4a82-85d1-6cbb4d0c5728 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.157559 Jul 21 22:55:47.303440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 186/369] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:47.555563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.556398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.562566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.563254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.567137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.567137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.709485 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.714598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.716325 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.716774 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.717796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.718234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.801643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.813560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e1419344-173e-403b-b7f9-5ed534db1d7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.261787 Jul 21 22:55:47.814464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 184/370] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:47.913747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.921161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9376b74b-2836-48a6-8210-9dedae4bef60 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1508 microversion: 2.1 time: 0.216125 Jul 21 22:55:47.921987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 187/371] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:47.997825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.998409 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.005560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.006013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.006827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.007424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.011929 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:48.285493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.296229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-03086ec0-75a0-4bf5-84d6-3c106510d479 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1204 microversion: 2.1 time: 0.302315 Jul 21 22:55:48.296836 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 185/372] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1204 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:48.321422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.322415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.331705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.332464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.333437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.334096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.519819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.536358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.539135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.540650 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-19b40d25-d9a6-4fa8-bd1e-b8e2f571c929 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.223720 Jul 21 22:55:48.541766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 188/373] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:48.838362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.848818 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.860531 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.860994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.861861 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.862390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.940334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.940940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.964983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.967941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.969212 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.978815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.081855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.095869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-977eb0a1-ad85-4f31-9d8a-fee700543011 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.267669 Jul 21 22:55:49.096640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 186/374] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:49.171363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.186979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cf221102-4120-4fea-94a9-49e22e20ca39 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1514 microversion: 2.1 time: 0.251747 Jul 21 22:55:49.188528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 189/375] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:49.314608 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:49.316033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:49.324806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.326301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.328410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.329216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.560488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:49.560488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:49.568938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.574337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.576176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.581625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.583397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.597598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c2876ec3-ee30-4c3b-a2aa-439e2a4ee71e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1272 microversion: 2.1 time: 0.287524 Jul 21 22:55:49.599043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 187/376] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:49 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:49.865665 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.878844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.881294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.882175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dfc19bc4-0012-478a-9172-05bf8d28366c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.326666 Jul 21 22:55:49.882891 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 190/377] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:49 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:50.115764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.116666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.118900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:50.127314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.127764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.128541 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.129259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.385467 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=8 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:50.415820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.432679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c68789a0-d1eb-4411-9e8e-e8abd942327f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.321479 Jul 21 22:55:50.433283 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 188/378] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:50.503282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-7fd66b14-aca3-44e4-9616-21bf12c71256 req-072f1467-306d-42ae-86e4-bb12d010c8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:50.518506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-7fd66b14-aca3-44e4-9616-21bf12c71256 req-072f1467-306d-42ae-86e4-bb12d010c8eb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.519839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-7fd66b14-aca3-44e4-9616-21bf12c71256 req-072f1467-306d-42ae-86e4-bb12d010c8eb service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.549713 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-7fd66b14-aca3-44e4-9616-21bf12c71256 req-072f1467-306d-42ae-86e4-bb12d010c8eb service nova] Creating event network-changed:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 22:55:50.559292 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-7fd66b14-aca3-44e4-9616-21bf12c71256 req-072f1467-306d-42ae-86e4-bb12d010c8eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067996 Jul 21 22:55:50.560703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 191/379] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:50.619352 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.620182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.631041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.631496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.632271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.632700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.902377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.903106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.918291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.918291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.918721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.919185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.941223 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.954353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8b9c01cc-943f-4684-9682-31cc420842b2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.339286 Jul 21 22:55:50.956935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 189/380] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:51.103374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2393208a-5bdb-4659-a356-35627e31e95c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: .version_select at 0x7fc5e48e6c10>, body: {"keypair": {"name": "tempest-keypair-1063474939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRpbdj8WKQwcW7JbWbQmyIAj8xEK83dG+H8TI5sRm1KZoMflknHCsl4L1CK03i12W40gQhhJk0DiD8l2+0Zo3UU6w6/Uz4CvYBwsDNdz4lE+eLlCkRzKAP7tZCTTc2cPw=="}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:51.142845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-2393208a-5bdb-4659-a356-35627e31e95c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:51.155933 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-2393208a-5bdb-4659-a356-35627e31e95c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for user 4947466838974a71815561640fa55c14 and project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:51.175233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.188507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.190362 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.191732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-779026f6-95ae-4745-b093-44cb216e6d28 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.294495 Jul 21 22:55:51.192779 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 192/381] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:51.350000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2393208a-5bdb-4659-a356-35627e31e95c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.250927 Jul 21 22:55:51.350843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 190/382] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:55:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:55:51.449596 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:51.450567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:51.459012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.461845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.461845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.461845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.489313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:51.651200 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.663960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5d1d5767-8bf8-4ce1-baee-f4d33d860697 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.218300 Jul 21 22:55:51.665577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 193/383] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:51 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:51.975736 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:51.976803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:51.984985 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.985705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.986670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.997146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.204595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.213050 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:52.213657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:52.215799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e1f03f54-80ec-4a25-bcb3-5cadaf0ac1ef tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.246620 Jul 21 22:55:52.216387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 191/384] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:51 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:52.221170 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.221622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.222399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.222857 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.371659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.379600 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.381773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.382971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-20fe01e3-c62e-4ef5-8957-7f62c57f0ec6 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.175155 Jul 21 22:55:52.384860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 194/385] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:52 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:52.686643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:52.687460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:52.697176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.698003 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.698942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.699595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.926380 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.940375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2d0307a5-c839-40b9-9004-c55c55aecbb7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.257654 Jul 21 22:55:52.941337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 192/386] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:52 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:53.237421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.238571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:53.245837 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.246290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.247800 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.248314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.412364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.415186 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:53.423382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.427394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.429098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.430746 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.456649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.466131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c1e5665a-5ce4-4dda-9af4-8273635dbce5 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.232456 Jul 21 22:55:53.467065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 195/387] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:53.740486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.754337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.758410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.761012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3b1f8353-0a55-4c30-9531-c28f58239ff9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.354113 Jul 21 22:55:53.764389 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 193/388] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:53.974996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.980193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.001583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.002379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.003752 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.004459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.229924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.239290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-45f088c7-2202-4078-a15d-ad7800eb40af tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.282683 Jul 21 22:55:54.250528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 196/389] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:54.484365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:54.485143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.495625 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.496294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.497297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.497947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.769838 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.780943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b11e7169-8d88-4e75-893f-cdec4e125b8a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.301072 Jul 21 22:55:54.785843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:54.786593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.790888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 194/390] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:54 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:54.793788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.794242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.795298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.795900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.970294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.983784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.991432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.993087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-77979d7e-5d2c-41eb-a692-cdcc80dd280b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.214487 Jul 21 22:55:54.994170 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 197/391] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:54 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:55.030564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1406736790", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "418e802f-29ea-4a0c-b0db-8f680811e4d1"}], "security_groups": [{"name": "tempest-securitygroup--2018999913"}], "key_name": "tempest-keypair-1063474939", "user_data": "}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:55:55.256811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:55.258406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:55.266466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.267801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.270282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.270983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.452406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:55.461768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4afabad0-1198-43d2-9390-fecdd77cf660 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.209024 Jul 21 22:55:55.462411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 198/392] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:55 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:55.798577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:55.799217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:55.810286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.810763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.811707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.812148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.053791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.053791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c1b1fe83-efda-449c-84d4-c83fb308f26b tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.198355 Jul 21 22:55:56.053791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 199/393] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:55 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:56.053791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:56.054185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:56.054185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.054185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.054185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.054454 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.189682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.198181 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.199820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.200985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d47f9eb2-b021-4936-8153-acd9e38e6c7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.193962 Jul 21 22:55:56.202807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 200/394] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:56 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:56.487552 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:56.488252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:56.496537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.497414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.500083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.500530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.702388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.710375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6853b303-a77e-4e1e-9eed-de534c1152d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.235435 Jul 21 22:55:56.711489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 201/395] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:56 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:56.940334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] validate_networks() for [('418e802f-29ea-4a0c-b0db-8f680811e4d1', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:55:57.068940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.072339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.097872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.098365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.099262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.100216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.324084 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.333074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b9548ac6-98e6-467a-a255-846a3c034b5c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.267946 Jul 21 22:55:57.334550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 202/396] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:57.339197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.339742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.345971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.346635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.347767 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.348374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.473441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:55:57.473863 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:55:57.474891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:55:57.475297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:55:57.475712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:55:57.487729 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.488123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.492403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.493047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.520704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:55:57.525063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Getting quotas for user 4947466838974a71815561640fa55c14 and project 755a70c4912f4795ae67cf9f036e02aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:55:57.540281 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:55:57.542974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:55:57.572746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.583431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.585842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.588108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bdbf2e63-0113-4a48-be8c-0e5bd7f6f230 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.252516 Jul 21 22:55:57.588757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 203/397] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:57.689859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-466adf2d-4c31-406b-a6b9-f44b30e77f69 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.664152 Jul 21 22:55:57.695767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 195/398] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:55:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:55:57.701203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-21629d7e-76c0-46bc-8b59-197356ece320 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.701950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-21629d7e-76c0-46bc-8b59-197356ece320 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.729016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.729918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.744709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.746460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.747645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.748731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.765950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-21629d7e-76c0-46bc-8b59-197356ece320 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.773869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-21629d7e-76c0-46bc-8b59-197356ece320 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1246 microversion: 2.1 time: 0.076712 Jul 21 22:55:57.785445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 204/399] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:57.920883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.938942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-498b218c-8247-45d7-ace4-2bd34be8c6c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.206671 Jul 21 22:55:57.940134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 196/400] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:58.352583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.353685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.362611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.363357 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.364358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.365006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.567619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.575504 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fbab5620-7a65-46f8-8367-4af54c18ff43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.228498 Jul 21 22:55:58.588539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 205/401] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:58.606685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.608771 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.616510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.617548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.617903 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.618354 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.793198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.794071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.803154 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.806872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.807776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.811657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.812203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.812987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.813648 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.814901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b5937e55-0184-4aa9-aa20-9ca1cca0f175 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.212349 Jul 21 22:55:58.815595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 197/402] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:58.890535 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.898659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-88f11027-ee71-4740-888c-8348b11ec1f0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1250 microversion: 2.1 time: 0.109800 Jul 21 22:55:58.899933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 206/403] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:58.956585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.957252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.976677 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.977296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.978191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.988922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.195703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.206820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c8cd7497-1581-43e1-8ad9-30213f3bb557 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.254678 Jul 21 22:55:59.209740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 198/404] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:59.593056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:59.593666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:59.601703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.602143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.603049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.603502 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.752439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.760524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f858c13d-8aba-4983-9334-fb57596b71c9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.171690 Jul 21 22:55:59.761093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 207/405] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:59 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:59.833266 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:59.834437 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:59.841068 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.841521 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.842284 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.842722 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.915555 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:59.916165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:59.922852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.923344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.924119 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.924557 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.991797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.005394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1449fcc6-8f22-4cdb-ac05-b0cc4aefe1fe tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1298 microversion: 2.1 time: 0.093388 Jul 21 22:56:00.007436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 208/406] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:59 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:00.044570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.047497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.049092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.050335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6f431099-4308-4583-b14d-8c5816710b19 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.221153 Jul 21 22:56:00.051001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 199/407] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:59 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:00.227372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:00.235819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:00.250454 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.250915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.253725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.254180 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.442820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.453101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e034f7d8-334a-43d9-b8e5-c4d523530356 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.229392 Jul 21 22:56:00.463107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 209/408] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:00 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:00.779845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:00.780621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:00.788483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.792895 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.792895 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.792895 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.994283 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.002151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c350865c-2cbd-450d-867a-64816903837e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.226133 Jul 21 22:56:01.002734 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 200/409] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:00 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:01.023733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.024420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.031109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.031550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.032337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.032776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.075652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.076373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.083078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.083623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.085388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.086015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.115319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.125201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-18a57ac8-fc99-4402-8a1b-c9cebbf87224 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1304 microversion: 2.1 time: 0.105723 Jul 21 22:56:01.126906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 210/410] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:01.264901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.275047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.276743 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.278034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-24a2ef83-fd1b-4995-baeb-858958c5759d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1740 microversion: 2.20 time: 0.206599 Jul 21 22:56:01.282848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 201/411] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:01.471159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.477197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.483846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.484298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.485081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.485509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.489865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:01.659796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.669303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f3cf8000-dc3e-4fed-9c5d-8e549e117340 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.202334 Jul 21 22:56:01.670685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 211/412] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:01.687361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-d0843072-ebbc-4ef1-80d2-6f3ba15659eb req-1c4031d9-6374-4093-a255-0e912b68e031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "name": "network-vif-plugged", "status": "completed", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:01.697302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-d0843072-ebbc-4ef1-80d2-6f3ba15659eb req-1c4031d9-6374-4093-a255-0e912b68e031 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.697745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-d0843072-ebbc-4ef1-80d2-6f3ba15659eb req-1c4031d9-6374-4093-a255-0e912b68e031 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.709647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-d0843072-ebbc-4ef1-80d2-6f3ba15659eb req-1c4031d9-6374-4093-a255-0e912b68e031 service nova] Creating event network-vif-plugged:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 22:56:01.715102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-d0843072-ebbc-4ef1-80d2-6f3ba15659eb req-1c4031d9-6374-4093-a255-0e912b68e031 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 Jul 21 22:56:01.716115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 202/413] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:02.019480 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.019996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.026324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.027051 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.027561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.028008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.145313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.146047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.154192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.154645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.155468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.155888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.174160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.183972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4e81ec8b-9577-46e6-93bb-c1168bad2ba7 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.168385 Jul 21 22:56:02.184814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 212/414] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:02.300499 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.301183 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.307383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.307942 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.308784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.309359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.448782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.459308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.461527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.463021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5291e780-72cf-48d5-b8cc-a1f779844481 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1722 microversion: 2.20 time: 0.166697 Jul 21 22:56:02.464356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 213/415] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:02.492037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.500455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0e28c49b-8518-48ba-b96f-9e5da0131908 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.361229 Jul 21 22:56:02.501040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 203/416] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:02.687731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.688335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.695429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.695934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.696714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.697156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.925286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.935293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d1298c01-05ef-4884-abbd-ff107369400e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.251691 Jul 21 22:56:02.939353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 214/417] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:03.146435 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-75369696-3a83-44a3-9ebd-b0ced389d40b req-226c6af2-b63b-4fce-95df-d988f865de34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:03.156932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-75369696-3a83-44a3-9ebd-b0ced389d40b req-226c6af2-b63b-4fce-95df-d988f865de34 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.157387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-75369696-3a83-44a3-9ebd-b0ced389d40b req-226c6af2-b63b-4fce-95df-d988f865de34 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.161833 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:03.169487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-75369696-3a83-44a3-9ebd-b0ced389d40b req-226c6af2-b63b-4fce-95df-d988f865de34 service nova] Creating event network-changed:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:56:03.175251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-75369696-3a83-44a3-9ebd-b0ced389d40b req-226c6af2-b63b-4fce-95df-d988f865de34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032903 Jul 21 22:56:03.176249 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 204/418] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:56:03.202016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.202962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.212980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.213820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.214644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.215116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.404503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.412844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-84a53002-3ee3-44e8-b6f8-69cb458c7602 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.215173 Jul 21 22:56:03.413507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 215/419] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:03.482653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.483370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.489632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.490701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.491495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.491930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.517386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.517993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.524079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.524532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.550174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.550174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.626976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.635075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.636589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.637753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a6a11731-cff2-4b7d-ac83-1242d0ac6033 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1722 microversion: 2.20 time: 0.159809 Jul 21 22:56:03.638319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 205/420] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:03.700944 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.709064 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a9759c64-51b0-47a0-b6f4-7a6154292f95 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.195554 Jul 21 22:56:03.709824 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 216/421] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:03.953335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.953939 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.960752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.961195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.962152 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.962760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.148675 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.157073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-eb53ef3e-7bd7-4909-a8b1-35614ef5cfb6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1725 microversion: 2.1 time: 0.207457 Jul 21 22:56:04.157593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 206/422] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:04.429577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.430094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.436768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.437762 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.438034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.438471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.587274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.595258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-65ab4228-aa14-4965-bdce-d4e7d71c28b1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1260 microversion: 2.1 time: 0.169641 Jul 21 22:56:04.595954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 217/423] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:04.655339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.655938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.661960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.663407 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.663407 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.663636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.725501 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.726252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.732750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.733252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.734078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.734514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.838486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.846953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.848516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.849680 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2860e773-9c34-469e-9cf8-7f001d661417 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1722 microversion: 2.20 time: 0.198260 Jul 21 22:56:04.851823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 207/424] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:04.860967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82bdd195-a04d-440a-ba2f-ac8fd086bf2d", "device": "/dev/sdb"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:04.862617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.869431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.869987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.870853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.871361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.915175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.922615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f08cf465-3aaa-4dab-be40-32d2fc6da820 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.201017 Jul 21 22:56:04.923452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 218/425] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:05.174494 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.175134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.181773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.182227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.183085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.183520 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.314145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.321920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b377f4b1-a5ec-4c6c-b681-acfc3b670bf6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1702 microversion: 2.1 time: 0.151210 Jul 21 22:56:05.322484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 219/426] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:05.338066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6d489947-7b96-491b-93f0-43be465ee8ca tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:05.344393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6d489947-7b96-491b-93f0-43be465ee8ca tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.344833 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6d489947-7b96-491b-93f0-43be465ee8ca tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.367707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6d489947-7b96-491b-93f0-43be465ee8ca tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Going to try to start instance {{(pid=124925) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 22:56:05.534626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6d489947-7b96-491b-93f0-43be465ee8ca tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action" status: 202 len: 0 microversion: 2.1 time: 0.200543 Jul 21 22:56:05.535448 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 220/427] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:56:05 2022] POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:56:05.540998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-60e36639-1738-4718-84e2-296f4c7f0e8d req-0bbd8ffa-6151-4104-9d43-4d587515f583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "name": "network-vif-unplugged", "status": "completed", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:05.549138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-60e36639-1738-4718-84e2-296f4c7f0e8d req-0bbd8ffa-6151-4104-9d43-4d587515f583 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.549636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-60e36639-1738-4718-84e2-296f4c7f0e8d req-0bbd8ffa-6151-4104-9d43-4d587515f583 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.560392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-60e36639-1738-4718-84e2-296f4c7f0e8d req-0bbd8ffa-6151-4104-9d43-4d587515f583 service nova] Creating event network-vif-unplugged:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:56:05.565302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-60e36639-1738-4718-84e2-296f4c7f0e8d req-0bbd8ffa-6151-4104-9d43-4d587515f583 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028471 Jul 21 22:56:05.565817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 221/428] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:05.570709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.571416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.577551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.578006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.578809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.579218 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.719447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.727373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9243fa67-2451-4b31-a524-0b57328a1fe3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1711 microversion: 2.1 time: 0.160487 Jul 21 22:56:05.728189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 222/429] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:05.732736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.733336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.740163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.740685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.741506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.741958 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.876719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.884814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5440966c-6729-4c58-a326-74452de50ec2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1443 microversion: 2.1 time: 0.155836 Jul 21 22:56:05.885380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 223/430] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:05.889742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.890333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.895925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.896379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.897149 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.897585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.026263 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.034221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.035746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.036884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c8b9c352-18e7-4159-b3e2-6bd966fe4cbc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1722 microversion: 2.20 time: 0.150613 Jul 21 22:56:06.037437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 224/431] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:06.041797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:06.042382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:06.048123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.048571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.049326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.049749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.184003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.191977 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-98c2b2c4-e26f-4149-84b7-e1ce62bfc2e6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1443 microversion: 2.1 time: 0.153582 Jul 21 22:56:06.192551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 225/432] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:06 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:06.197587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:06.198196 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:06.204456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.204456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.205157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.205596 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.341662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.349448 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-db9ae8ce-4bef-42c9-8ac6-e73bd5105caa tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.155921 Jul 21 22:56:06.350012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 226/433] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:06 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:06.746426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:06.747931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:06.754712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.755195 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.756235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.756828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.778372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:06.953190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.961902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7b89a8cf-68ce-4ece-9789-5caea2a8d3d6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1711 microversion: 2.1 time: 0.221337 Jul 21 22:56:06.962677 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 227/434] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:06 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1711 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:07.055214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:07.056694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.064547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.064994 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.065793 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.066230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.325289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.337481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.339561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.341757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8efe80a5-b6bc-4458-a0c8-f9abe2aa25f2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1722 microversion: 2.20 time: 0.290582 Jul 21 22:56:07.342968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 228/435] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:07 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:07.366431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:07.367283 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.376577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.377298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.378384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.379002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.505831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:07.533928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=10 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:07.541106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.548516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d1f9fb5-e150-4504-bd20-1d5198654d96 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.186826 Jul 21 22:56:07.549076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 229/436] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:07 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:07.628565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4c9104f2-0242-4e83-b7a7-b9c02c482e4b tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "POST /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.776200 Jul 21 22:56:07.631833 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 208/437] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:56:04 2022] POST /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff/os-volume_attachments => generated 194 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:07.980169 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:07.981150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.983904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:07.989601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.990379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.991271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.991968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.140758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.149394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a011d638-c11d-479c-a39d-f0901043b01c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1711 microversion: 2.1 time: 0.173540 Jul 21 22:56:08.149997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 230/438] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:07 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:08.361680 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:08.362557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.371372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.373578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.373578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.373578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.566202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:08.566826 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.574549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.574819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.575638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.576185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.626645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.639502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.642407 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.644348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8fc986d5-3768-4ec0-9e3c-4fc54ee63c87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1665 microversion: 2.20 time: 0.287516 Jul 21 22:56:08.644979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 209/439] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:08 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1665 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:08.663237 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d01bfc63-9604-4362-bec9-64c1a4752cdc"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:08.665295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.671653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:08.673754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.674789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.676377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.677186 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.730805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.741211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-abd5df45-6138-4f80-9a02-67d0d1cf6384 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.179669 Jul 21 22:56:08.754807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 231/440] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:08 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:08.912964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-455e7ddb-38fc-4cbd-8d74-42aa90d82ea7 req-66c4b832-67e9-4a00-905d-1624629824e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:08.924047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-455e7ddb-38fc-4cbd-8d74-42aa90d82ea7 req-66c4b832-67e9-4a00-905d-1624629824e2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.924677 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-455e7ddb-38fc-4cbd-8d74-42aa90d82ea7 req-66c4b832-67e9-4a00-905d-1624629824e2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.960039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-455e7ddb-38fc-4cbd-8d74-42aa90d82ea7 req-66c4b832-67e9-4a00-905d-1624629824e2 service nova] Creating event network-changed:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 22:56:08.965651 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-455e7ddb-38fc-4cbd-8d74-42aa90d82ea7 req-66c4b832-67e9-4a00-905d-1624629824e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062302 Jul 21 22:56:08.966873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 232/441] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:56:09.168525 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:09.169257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:09.171770 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:09.178493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.179134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.180156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.180748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.386231 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.397229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f06268bc-8fd6-4d56-9254-5c15fff75f5b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1711 microversion: 2.1 time: 0.234940 Jul 21 22:56:09.398818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 233/442] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:09 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1711 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:09.770757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:09.770757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:09.777613 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.778452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.779441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.780463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.954251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e118ebfb-080a-4dc8-81b1-a69930c4a023 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.296190 Jul 21 22:56:09.956261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 210/443] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jul 21 22:56:08 2022] POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 188 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:56:10.101705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.110992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b26664b3-2026-4327-b9c5-2382139e40e3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.354375 Jul 21 22:56:10.122763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 234/444] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:09 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:10.138391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:10.139006 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.145910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.146571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.147528 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.148703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.385133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2d2fe257-d469-42ed-8ac1-fb4179ab05d4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/action" status: 202 len: 0 microversion: 2.20 time: 0.250689 Jul 21 22:56:10.385984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 211/445] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 21 22:56:10 2022] POST /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:56:10.394314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:10.395138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.403058 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.403543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.404487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.405264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.418253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:10.419503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.428795 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.429507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.430345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.430817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.570751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.581938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.583821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.585282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-145ba2ca-32fa-451a-b838-7950d37a0f74 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1751 microversion: 2.20 time: 0.195063 Jul 21 22:56:10.586363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 235/446] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:10 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:10.615633 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.624583 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3be43090-3eaf-482c-b1dc-aedc225ad500 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1711 microversion: 2.1 time: 0.211097 Jul 21 22:56:10.625337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 212/447] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:10 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1711 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:10.759592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1164927252", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:10.821021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] validate_networks() for None {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:56:11.097924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:56:11.098340 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:56:11.098899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:56:11.099306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:56:11.099708 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:56:11.109970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.111076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.111970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.112410 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.129955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Getting quotas for project f64f9241e0da4e8f98fb1ad5b46d836d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:56:11.130222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.130865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.135503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Getting quotas for user 8677c914de1d4eb1b3e8c36eabbb0ade and project f64f9241e0da4e8f98fb1ad5b46d836d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:56:11.137375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.137840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.138924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.139511 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.148675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:56:11.150959 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:56:11.269876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.288065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c36e8de0-7608-4dbf-b850-2a4653f02635 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.152403 Jul 21 22:56:11.288065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 213/448] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:11.292111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1d76d462-334b-4cd7-ae3a-b1f2bb631952 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539369 Jul 21 22:56:11.293060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 236/449] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:56:11.302929 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-924f9d74-767b-46e7-acd7-1b3f1caa8138 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.303635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-924f9d74-767b-46e7-acd7-1b3f1caa8138 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.361431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-924f9d74-767b-46e7-acd7-1b3f1caa8138 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.368967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-924f9d74-767b-46e7-acd7-1b3f1caa8138 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1215 microversion: 2.1 time: 0.069893 Jul 21 22:56:11.369675 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 214/450] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:11.606421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.607111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.613776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.614220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.615073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.615504 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.641598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.642357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.653865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.654318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.655194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.655632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.756245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.765892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.767784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.768953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6cb633d0-2292-4be3-b623-d1fba56706cb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1751 microversion: 2.20 time: 0.167944 Jul 21 22:56:11.769508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 237/451] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:11.774400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-ac8756c7-b9f7-40b0-b449-04c2d5944cef req-39a66ecd-7d04-470a-aced-a16380ee1650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "name": "network-vif-plugged", "status": "completed", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:11.785537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-ac8756c7-b9f7-40b0-b449-04c2d5944cef req-39a66ecd-7d04-470a-aced-a16380ee1650 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.785974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-ac8756c7-b9f7-40b0-b449-04c2d5944cef req-39a66ecd-7d04-470a-aced-a16380ee1650 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.797535 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-ac8756c7-b9f7-40b0-b449-04c2d5944cef req-39a66ecd-7d04-470a-aced-a16380ee1650 service nova] Creating event network-vif-plugged:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:56:11.802627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-ac8756c7-b9f7-40b0-b449-04c2d5944cef req-39a66ecd-7d04-470a-aced-a16380ee1650 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Jul 21 22:56:11.803525 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 238/452] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:11.815451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.824128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d57875bf-7922-4fba-a0d2-2e925fa70b94 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1715 microversion: 2.1 time: 0.186505 Jul 21 22:56:11.824735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 215/453] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1715 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:12.296166 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:12.296925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:12.303261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.303719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.305030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.305470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.386137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1cdcaf22-fc48-4b00-9f13-630080a41ada tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:12.386755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1cdcaf22-fc48-4b00-9f13-630080a41ada tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:12.436660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.444181 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-aa770ef4-fa54-4814-9bf3-97f5202f0169 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.152328 Jul 21 22:56:12.444760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 239/454] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:12.451230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1cdcaf22-fc48-4b00-9f13-630080a41ada tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.458053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1cdcaf22-fc48-4b00-9f13-630080a41ada tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1215 microversion: 2.1 time: 0.076412 Jul 21 22:56:12.459660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 216/455] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:12.788040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:12.789235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:12.795752 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.796281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.797049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.797507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.925399 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.933796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.935346 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.936531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-11288bea-246b-470d-b02f-64af92c32679 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.152467 Jul 21 22:56:12.937086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 240/456] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:13.461107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:13.461718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:13.469386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.470090 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.470951 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.471397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.474920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:13.475550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:13.481647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.482060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.482843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.483271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.543835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.551486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-61d81dff-ed9b-4450-9539-27c95cec77f9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1211 microversion: 2.1 time: 0.080394 Jul 21 22:56:13.561482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 241/457] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:13 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:13.608704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.616205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-91897955-592f-4b83-bd7b-9a4b1a78543e tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1372 microversion: 2.1 time: 0.159938 Jul 21 22:56:13.617627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 217/458] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:13 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:13.954635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:13.955273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:13.961784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.962230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.963139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.963576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.092618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.101236 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.103302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.104477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e724e14e-eae9-4f0a-835f-ab83ac186ce8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.153870 Jul 21 22:56:14.105028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 242/459] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:13 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:14.573744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.574347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.580890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.581335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.582092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.582527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.599849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:14.635515 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.636510 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.643065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.643949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.645897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.646618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.649179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.656617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7b42103c-a0f9-4254-92d4-72622f631f2c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1267 microversion: 2.1 time: 0.086663 Jul 21 22:56:14.657677 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 218/460] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:14 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:14.786194 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.793736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8846f7fa-9431-40d6-b1fa-e9077a509ba7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1566 microversion: 2.1 time: 0.162975 Jul 21 22:56:14.794299 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 243/461] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:14 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:14.812911 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.813399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.820160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.821125 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.821876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.822306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.901906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1d08a89a-eefa-4202-9642-877ac90aa781 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092659 Jul 21 22:56:14.902500 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 219/462] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:56:14 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:15.123590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:15.124795 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:15.131754 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.132395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.133968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.134604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.293207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.302846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.305460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.307062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-68de7aa6-9543-4709-b657-673a01cc868a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.188586 Jul 21 22:56:15.310370 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 244/463] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:15 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:15.674054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:15.674655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:15.682015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.682464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.685032 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.685032 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.745303 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.752664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6700b11e-d7bd-4d24-bddc-9a73b4efc990 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1273 microversion: 2.1 time: 0.083022 Jul 21 22:56:15.753445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 220/464] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:15 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:16.221979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-b76e6bca-36de-49e4-a2c2-b28ea0dbd007 req-6b6a021e-857e-4949-853c-8a7116907d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:16.231382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-b76e6bca-36de-49e4-a2c2-b28ea0dbd007 req-6b6a021e-857e-4949-853c-8a7116907d34 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.231926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-b76e6bca-36de-49e4-a2c2-b28ea0dbd007 req-6b6a021e-857e-4949-853c-8a7116907d34 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.243017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-b76e6bca-36de-49e4-a2c2-b28ea0dbd007 req-6b6a021e-857e-4949-853c-8a7116907d34 service nova] Creating event network-changed:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:56:16.249973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-b76e6bca-36de-49e4-a2c2-b28ea0dbd007 req-6b6a021e-857e-4949-853c-8a7116907d34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Jul 21 22:56:16.250954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 245/465] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:16.325953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:16.326558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:16.332734 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.333176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.333927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.334350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.587540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.596481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.598347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.599725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-727c9681-2202-46a2-abd2-91de6a5447fd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.277740 Jul 21 22:56:16.610906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 221/466] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:16 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:16.772978 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:16.773871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:16.781571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.782013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.782808 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.783240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.011374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.022394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:17.025803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-db037458-d68c-49b4-af8f-5e338c6009a7 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.257159 Jul 21 22:56:17.031904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 246/467] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:16 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:17.274041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-a2851cec-4a32-4c48-be17-ae01d4bb8e00 req-205542fd-3e4f-46d3-b262-d6fadfc2a517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfdde86-def0-4598-8128-6a93a4410338", "tag": "ebfa715d-7390-4d63-9886-cae8ef118a11"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:17.283670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a2851cec-4a32-4c48-be17-ae01d4bb8e00 req-205542fd-3e4f-46d3-b262-d6fadfc2a517 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.284215 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a2851cec-4a32-4c48-be17-ae01d4bb8e00 req-205542fd-3e4f-46d3-b262-d6fadfc2a517 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.308922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-a2851cec-4a32-4c48-be17-ae01d4bb8e00 req-205542fd-3e4f-46d3-b262-d6fadfc2a517 service nova] Creating event network-changed:ebfa715d-7390-4d63-9886-cae8ef118a11 for instance 8dfdde86-def0-4598-8128-6a93a4410338 on hv-cinder-85069 Jul 21 22:56:17.319820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-a2851cec-4a32-4c48-be17-ae01d4bb8e00 req-205542fd-3e4f-46d3-b262-d6fadfc2a517 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051503 Jul 21 22:56:17.320620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 222/468] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:56:17.620540 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:17.621849 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:17.634100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.634785 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.635786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.636606 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.835492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.844805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.846489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.847693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e6e377f3-eae9-4746-b0f1-da7015abd78d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.233743 Jul 21 22:56:17.858683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 247/469] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:17 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:18.048624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:18.049310 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:18.056001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.056444 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.057201 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.057627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.187418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.194764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-dd41d8ea-23e0-49f4-826b-d80479c292c3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.150533 Jul 21 22:56:18.196154 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 223/470] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:18 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:18.865454 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:18.866057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:18.872506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.872996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.873760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.874195 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.006353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.016480 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.018067 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.019331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f85a5c31-a0c1-4283-b6f3-b76b750203bd tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.157791 Jul 21 22:56:19.019884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 248/471] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:18 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:19.213217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:19.213737 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:19.220522 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.220963 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.221710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.222135 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.348329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.355736 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3b9e99b5-b306-4887-b107-bd251e4d5b88 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.147128 Jul 21 22:56:19.356300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 224/472] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:19 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:20.038046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:20.038694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:20.045679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.046126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.046904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.047333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.173498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.182559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.184097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.185240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3548d45c-461c-4ca9-bf0c-0c1ef44ba709 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.151116 Jul 21 22:56:20.185792 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 249/473] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:20 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:20.372706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:20.373307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:20.379891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.380336 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.381092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.381525 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.512882 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.520296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-09dc1fdc-e7ff-40a0-9d77-4d682b924a21 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.151435 Jul 21 22:56:20.520863 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 225/474] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:20 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:21.203173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:21.203734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:21.206032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:21.206761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:21.211694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.212145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.212967 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.213403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.340957 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.349679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.351220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.352901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3291c2e6-b21f-4a03-9717-e49e7773a8c9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.153801 Jul 21 22:56:21.353462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 250/475] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:21 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:21.537163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:21.537776 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:21.544935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.545386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.546150 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.546590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.671385 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.678834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-74ae7d67-4af1-4041-9b13-d3ce02297344 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.145550 Jul 21 22:56:21.679407 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 226/476] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:21 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:22.370935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:22.371541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:22.378047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.378501 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.379293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.379732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.510993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.519647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.521158 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.522319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8896f7f6-d3e0-48d6-9aff-4e1f3c41e2e4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.155457 Jul 21 22:56:22.522924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 251/477] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:22 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:22.696983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:22.697631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:22.699640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=4 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:22.705078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.708406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.708406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.708406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.840163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.847660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-22c318c6-cfb0-4090-9b70-e78626fee73e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.155345 Jul 21 22:56:22.848222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 227/478] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:22 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:23.540864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:23.541579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:23.548660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.549698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.550126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.550632 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.686486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.695916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.697550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.698812 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e5d73648-86cc-442d-a3a3-d9dcf56f630d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1753 microversion: 2.20 time: 0.162555 Jul 21 22:56:23.699461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 252/479] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:23 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:23.865044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:23.865653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:23.872168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.872611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.873368 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.873801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.000219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.007773 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-beacea60-8b3d-4cc2-bd81-a7c82a1652d0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.146572 Jul 21 22:56:24.009080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 228/480] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:23 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:24.717173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:24.717777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:24.724647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.725082 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.725849 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.726285 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.859251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.867761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.869273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.870427 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-05ca792f-54fe-4740-9442-6437fad36157 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.157192 Jul 21 22:56:24.871058 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 253/481] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:24 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:25.025773 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:25.026376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:25.032823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.033279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.034045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.034482 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.160643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.168254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-27a992fc-f508-43ef-84d7-78a941b738b3 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.146818 Jul 21 22:56:25.168832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 229/482] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:25 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:25.888384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:25.888998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:25.895610 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.896066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.896834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.897272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.022559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.030934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.032451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.033605 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d3e7963-629e-4655-836f-7d7018dd757e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.149115 Jul 21 22:56:26.034165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 254/483] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:25 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:26.184937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:26.185480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:26.192008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.192456 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.193212 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.193645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.343974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.352712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ae78c1f5-5337-412f-b3c6-350e2e5e7653 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.171044 Jul 21 22:56:26.353285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 230/484] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:26 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:26.859469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:26.859958 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:26.866915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.867360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.868112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.868539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.892254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-150b1d32-62a8-4ac1-89bc-e2fc8a7eb1c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/ips" status: 200 len: 151 microversion: 2.1 time: 0.036615 Jul 21 22:56:26.892888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 255/485] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:56:26 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:27.052509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:27.053438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:27.059957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.060477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.061306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.061924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.204769 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:27.213576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:27.215033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:27.216230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bb5de8d8-8255-446a-8bb8-8ba21a260514 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.167830 Jul 21 22:56:27.216823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 231/486] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:27 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:27.370355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:27.370943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:27.378364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.379114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.384602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.384602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.516813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:27.524559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5dc2a682-c786-4fb7-8037-2f5445a7f877 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.159095 Jul 21 22:56:27.525103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 256/487] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:27 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:28.235150 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:28.235904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:28.242639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.242956 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.243652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.244076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.407776 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.417338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.419282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.420695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1bf885c1-2716-479c-b9d4-92fc8217ca6e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.189515 Jul 21 22:56:28.421491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 232/488] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:28 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:28.541696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:28.542344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:28.548955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.549407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.550172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.550629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.689721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.701751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0cf32d81-abd8-4f51-acef-4f43128e7c35 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.164113 Jul 21 22:56:28.702476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 257/489] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:28 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:28.706346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a23f592-54fd-4ee5-9b0e-4ac3a90aac20"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:28.707830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:28.715055 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.715508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.716286 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.716720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.439726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:29.440435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:29.446601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.447146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.447989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.448481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.836794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.845943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.847503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.848677 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-11f46b81-c504-41cb-81bc-ff7e7c67ff7c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.413325 Jul 21 22:56:29.849238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 258/490] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:29 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:29.853884 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:29.854486 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:29.861758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.862320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.863091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.863536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.997405 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.004989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0a7e499f-0485-41a6-b08c-7a576797efe0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.154538 Jul 21 22:56:30.005567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 259/491] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:29 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:30.717460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-e41c77db-e770-4ccc-b09d-338b8c202c75 req-3b7e4f87-e7e6-4d30-9b71-87efb2bda8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfdde86-def0-4598-8128-6a93a4410338", "name": "network-vif-plugged", "status": "completed", "tag": "ebfa715d-7390-4d63-9886-cae8ef118a11"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:30.728297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e41c77db-e770-4ccc-b09d-338b8c202c75 req-3b7e4f87-e7e6-4d30-9b71-87efb2bda8ef service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.728905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e41c77db-e770-4ccc-b09d-338b8c202c75 req-3b7e4f87-e7e6-4d30-9b71-87efb2bda8ef service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.749633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-e41c77db-e770-4ccc-b09d-338b8c202c75 req-3b7e4f87-e7e6-4d30-9b71-87efb2bda8ef service nova] Creating event network-vif-plugged:ebfa715d-7390-4d63-9886-cae8ef118a11 for instance 8dfdde86-def0-4598-8128-6a93a4410338 on hv-cinder-85069 Jul 21 22:56:30.754823 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-e41c77db-e770-4ccc-b09d-338b8c202c75 req-3b7e4f87-e7e6-4d30-9b71-87efb2bda8ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041078 Jul 21 22:56:30.755487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 260/492] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:56:30.868005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:30.869212 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:30.875818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.876388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.877261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.877764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.010954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.019598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.021139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.022351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-528a6991-a1e1-4d36-aeaa-ce19f8f467eb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.158890 Jul 21 22:56:31.022997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 261/493] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:30 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:31.027929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:31.028527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:31.034512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.035005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.035774 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.036272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.178503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.186213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-284f4b12-d41c-45a3-8fab-a2489b63367a tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.162239 Jul 21 22:56:31.186811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 262/494] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:31 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:32.041647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:32.042358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:32.048949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.049400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.050161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.050601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.188834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.198622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.200471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.201722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-60c05ef8-c02a-4778-9161-9bf6519314ef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.164176 Jul 21 22:56:32.216574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 263/495] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:32 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:32.216574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:32.216574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:32.220895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.221078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.221850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.222284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.240844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:32.366326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.373890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b0592810-1e9a-4981-8e7e-f63d85efe513 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.165710 Jul 21 22:56:32.374456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 264/496] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:32 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:33.226113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:33.226815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:33.233648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.234020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.234818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.235262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.397264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.406925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.408779 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.413105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a522e6b4-d544-43aa-9775-21748c6357ad tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.191191 Jul 21 22:56:33.414021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 265/497] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:33 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:33.419038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:33.419710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:33.426232 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.426683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.427503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.428029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.569771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.578130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-94ab14d3-c856-4672-a12d-b42348049200 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.163202 Jul 21 22:56:33.578713 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 266/498] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:33 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:34.431293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:34.431943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:34.438325 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.438785 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.439674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.440107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.575972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.584895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.586455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-30c045b1-2989-4035-9c44-8041a7c5f89b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.160311 Jul 21 22:56:34.588408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 267/499] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:34 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:34.597380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:34.598027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:34.604125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.604576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.605337 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.605774 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.741833 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.750140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3994fc63-9b95-44a6-a9bc-14c55b382180 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.156623 Jul 21 22:56:34.750868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 268/500] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:34 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:35.607218 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:35.607877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:35.614263 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.614766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.615632 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.616022 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.760561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.769280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.770879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.772040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4745bd41-2c8c-40e3-8aa7-30211190e041 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.169545 Jul 21 22:56:35.772926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 269/501] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:35 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:35.778098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:35.778693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:35.784854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.786571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.786571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.786571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.924100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.932671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6def954a-8592-41c2-b63a-7b895602db04 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.158855 Jul 21 22:56:35.933334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 270/502] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:35 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:36.723019 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:36.723676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:36.730760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.731231 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.732004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.732451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.864166 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lazy-loading 'services' on Instance uuid 294aeb91-ca3e-45e1-af6f-efe768e62fff {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:56:37.110129 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5625a85e-bd96-44fb-9c87-a74022695153 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "DELETE /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff/os-volume_attachments/82bdd195-a04d-440a-ba2f-ac8fd086bf2d" status: 202 len: 0 microversion: 2.1 time: 0.391661 Jul 21 22:56:37.113816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 271/503] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:56:36 2022] DELETE /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff/os-volume_attachments/82bdd195-a04d-440a-ba2f-ac8fd086bf2d => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:56:37.117038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:37.117731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:37.124852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.129638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.129638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.129638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.273549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.283010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.284521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.285671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d2f2abcf-5db1-4a2d-bdb6-70322890e43e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.173461 Jul 21 22:56:37.286233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 272/504] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:37 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:37.290695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:37.291315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:37.296987 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.297428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.298216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.298642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.429189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.436732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-892f0c90-6b27-4432-98aa-a2a9e70ca77c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.149533 Jul 21 22:56:37.437447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 273/505] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:37 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:38.304060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:38.305536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:38.313328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.313982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.315267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.316078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.462654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.472309 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.473894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.475610 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5df6db5f-6cb7-41c6-bae7-8e70014c4131 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.175589 Jul 21 22:56:38.481450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 274/506] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:38 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:38.487790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:38.488459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:38.496324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.496769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.497566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.498014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.638914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.646311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-38262678-f2e0-4702-b7a7-bdcfb752d8d8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.163257 Jul 21 22:56:38.646917 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 275/507] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:38 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:38.712977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=53 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:38.790986 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=87 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:39.496234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:39.496921 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:39.499803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:39.504769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.505216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.505999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.506420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.643676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.652880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.654551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.655753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-56e171bd-45e3-4ca3-b6e4-43d8e8dee6d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.164284 Jul 21 22:56:39.656568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 276/508] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:39 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:39.662689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:39.663360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:39.670009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.670463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.671284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.671718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.807902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.815883 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5b7be835-91cc-4a2a-bc88-d7986126e098 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.156945 Jul 21 22:56:39.816452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 277/509] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:39 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:40.675025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:40.675714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:40.683120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.683720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.684591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.685024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.817463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.826098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.827639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.828809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6400a554-4793-48cc-8711-e03afc1f7545 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.157724 Jul 21 22:56:40.829418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 278/510] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:40 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:40.833869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:40.834468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:40.840323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.843441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.843441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.843441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.981238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.988945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fcbc5c0e-30d4-4ce6-953f-fb9ec6ea3053 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.158552 Jul 21 22:56:40.989535 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 279/511] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:40 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:41.728182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8dedde2a-ce4f-471e-821f-1301946e697e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.025999 Jul 21 22:56:41.728780 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 233/512] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:56:28 2022] POST /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 194 bytes in 13028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:56:41.847214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:41.847838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:41.854317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.854796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.855591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.856010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.873705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:41.988751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.997742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.999295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:42.000464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d7fde89f-3d7d-44b1-bab5-ed06b7987225 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.157402 Jul 21 22:56:42.001032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 280/513] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:41 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:42.008070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:42.008765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:42.019209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:42.024468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:42.024468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:42.024468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:42.148639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:42.156689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-823648de-6d9a-4edf-8773-8e6f649e084d tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.153501 Jul 21 22:56:42.157272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 234/514] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:42 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:43.018970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.019548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.026174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.028419 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.028419 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.028624 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.157115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.165591 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.171786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.171786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-630bd508-3331-4a46-8caa-8a0666e87d1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.153438 Jul 21 22:56:43.171786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 281/515] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:43 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:43.173574 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.174181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.180852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.181300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.182058 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.182491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.316155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.323569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ab273e84-0c65-4c7c-bdb5-8f7bb61b7a20 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1315 microversion: 2.1 time: 0.154029 Jul 21 22:56:43.324662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 235/516] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:43 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:43.526991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.527516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.533683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.534131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.534920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.535358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.561528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:56:43.835297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2b17740f-b787-433d-b7bc-5d8b78477b46 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "DELETE /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 204 len: 0 microversion: 2.1 time: 0.311826 Jul 21 22:56:43.835922 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 282/517] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:56:43 2022] DELETE /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:56:43.846822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.846822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.851045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.851491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.852242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.852670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.985851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.993944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f1bd122b-f3b0-4f35-9102-1c9963b05162 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.153919 Jul 21 22:56:43.994549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 236/518] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:43 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:44.187387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.188109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.194466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.194946 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.195703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.196139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.323803 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.332347 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.333846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.335042 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c551ccd0-e70c-4495-a57c-72e6dd17f613 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.152037 Jul 21 22:56:44.335607 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 283/519] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:44 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:44.341609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.342211 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.348937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.349386 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.351840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.351840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.485473 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.493276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a4d6987d-3b9f-440f-b47f-a0f5fa052f58 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1465 microversion: 2.1 time: 0.155849 Jul 21 22:56:44.493853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 237/520] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:44 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:44.534061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.534550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.540792 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.541259 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.542005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.542440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.568432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:56:45.016281 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.016887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.022943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.023391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.024141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.024573 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.158056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.165574 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3ee3027d-ea8f-4661-a50e-a4a9c5873792 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.153198 Jul 21 22:56:45.166141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 238/521] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:45.353980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.354667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.361041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.361481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.362230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.362657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.475839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ec3e575e-e5ee-4518-95a3-4d3f1501f2a9 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 204 len: 0 microversion: 2.1 time: 0.945195 Jul 21 22:56:45.476468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 284/522] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:56:44 2022] DELETE /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:56:45.485123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.485879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.493883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.499005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.500294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.501122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.501563 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.516455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.518033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.519273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ccaee693-6d69-442e-9f74-c6b8132b423f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.169168 Jul 21 22:56:45.519838 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 239/523] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:45.638076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.646166 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1553f5a1-ab9a-4152-bafe-82ec9ded5e91 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1471 microversion: 2.1 time: 0.165397 Jul 21 22:56:45.646730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 285/524] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:46.182984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.183582 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:46.189945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.190388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.191172 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.191602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.322695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.330560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c4399b19-2c1f-4b87-8e2d-5941023e4504 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.151527 Jul 21 22:56:46.331175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 240/525] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:46.538406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.539140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:46.545815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.546274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.547379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.547816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.663388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.664066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:46.671103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.671557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.672460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.672786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.672913 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.681281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.682814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.683990 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-592c08fc-190f-49b0-bb0e-751cebed7472 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.149699 Jul 21 22:56:46.684555 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 286/526] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:46.798942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.806260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b849d42c-0845-4ca2-8d2d-9978dd09f21c tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1471 microversion: 2.1 time: 0.146756 Jul 21 22:56:46.806852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 241/527] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:47.347315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:47.347911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:47.353834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.354306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.355078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.355503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.487069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.494541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-65ec57d8-1dc8-4660-a710-e29ecf3e6404 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.151360 Jul 21 22:56:47.495139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 287/528] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:47 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:47.701975 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:47.702579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:47.709099 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.709551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.710320 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.710754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.823216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:47.823822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:47.830455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.830950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.831748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.832183 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.836175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.844498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.846266 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.847481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-75378153-5bbe-453b-87f3-f0ad3411367b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.149400 Jul 21 22:56:47.848248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 242/529] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:47 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:47.962449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.970685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5bab5273-e082-4774-a137-bc741f0d39ed tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1471 microversion: 2.1 time: 0.151008 Jul 21 22:56:47.971276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 288/530] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:47 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:48.511323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.511931 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.518470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.518966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.519735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.520168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.650123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:48.657653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f2a52182-3a3f-4312-b021-c03eab2fb6e0 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.150168 Jul 21 22:56:48.658233 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 243/531] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:48.865442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.865955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.872964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.873413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.874165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.874602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.988038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.988799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.995258 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.995713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.996486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.996934 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.004680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.013012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.014592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.016274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b82ef2f4-46b9-4d18-a604-0d131dc3212f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.154828 Jul 21 22:56:49.016842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 289/532] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:49.140756 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.144175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2c5f753a-6e70-4bea-ab5f-d65063d2641e tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1471 microversion: 2.1 time: 0.159962 Jul 21 22:56:49.144739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 244/533] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:49.674519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:49.675817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:49.682307 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.682808 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.683612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.684052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.847899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.860155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fba9e472-3b1c-457b-9ca1-b7bd321feffc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1513 microversion: 2.1 time: 0.189418 Jul 21 22:56:49.861806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 290/534] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:49 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:49.965306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-b5f5b818-69dc-4a61-aad1-c73a2441a7fb req-d2a7847c-8119-4e1e-b27a-c753295e35cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294aeb91-ca3e-45e1-af6f-efe768e62fff", "name": "network-vif-deleted", "tag": "7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:49.973963 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-b5f5b818-69dc-4a61-aad1-c73a2441a7fb req-d2a7847c-8119-4e1e-b27a-c753295e35cc service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.979562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-b5f5b818-69dc-4a61-aad1-c73a2441a7fb req-d2a7847c-8119-4e1e-b27a-c753295e35cc service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.985533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-b5f5b818-69dc-4a61-aad1-c73a2441a7fb req-d2a7847c-8119-4e1e-b27a-c753295e35cc service nova] Creating event network-vif-deleted:7e16a1d1-00cb-4b67-b01b-bd7ecbb8b739 for instance 294aeb91-ca3e-45e1-af6f-efe768e62fff on hv-cinder-85069 Jul 21 22:56:49.990348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-b5f5b818-69dc-4a61-aad1-c73a2441a7fb req-d2a7847c-8119-4e1e-b27a-c753295e35cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Jul 21 22:56:49.991213 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 245/535] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:50.035272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.037312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.042237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.042683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.043536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.043965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.162654 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.163696 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.175760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.178393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.179430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.182301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.227530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.245545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.247361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.253347 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6c2ada66-ff29-4f8d-91ef-8b012a082f50 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.221961 Jul 21 22:56:50.253946 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 291/536] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:50.269274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-4a1f0012-3434-494a-92f2-b5556c67652f req-3ababb2a-662e-4477-8a6a-b4553f215a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfdde86-def0-4598-8128-6a93a4410338", "name": "network-vif-deleted", "tag": "ebfa715d-7390-4d63-9886-cae8ef118a11"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:50.278005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4a1f0012-3434-494a-92f2-b5556c67652f req-3ababb2a-662e-4477-8a6a-b4553f215a85 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.278397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.278523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4a1f0012-3434-494a-92f2-b5556c67652f req-3ababb2a-662e-4477-8a6a-b4553f215a85 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.286957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e56e7303-31a0-4c69-9117-a569b7e382a8 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1429 microversion: 2.1 time: 0.129621 Jul 21 22:56:50.296231 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-4a1f0012-3434-494a-92f2-b5556c67652f req-3ababb2a-662e-4477-8a6a-b4553f215a85 service nova] Creating event network-vif-deleted:ebfa715d-7390-4d63-9886-cae8ef118a11 for instance 8dfdde86-def0-4598-8128-6a93a4410338 on hv-cinder-85069 Jul 21 22:56:50.296778 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 246/537] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:50.296892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-4a1f0012-3434-494a-92f2-b5556c67652f req-3ababb2a-662e-4477-8a6a-b4553f215a85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 Jul 21 22:56:50.296892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 292/538] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:50.878108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.878756 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.884662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.887640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.887640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.887640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.916146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.916643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.917080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lazy-loading 'fault' on Instance uuid 294aeb91-ca3e-45e1-af6f-efe768e62fff {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:56:50.964946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.973566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-002e44eb-9504-4179-b1ea-59421c44a902 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 200 len: 1308 microversion: 2.1 time: 0.099381 Jul 21 22:56:50.974131 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 247/539] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:51.272958 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.273661 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.286625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.286625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.286625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.286625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.312968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.312968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.319827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.320257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.321016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.321431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.354411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.354876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.355321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lazy-loading 'fault' on Instance uuid 8dfdde86-def0-4598-8128-6a93a4410338 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:56:51.399677 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8677c914de1d4eb1b3e8c36eabbb0ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f9241e0da4e8f98fb1ad5b46d836d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.407319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d70f455a-e42b-41ff-a4b4-cde478b98ef0 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 200 len: 1305 microversion: 2.1 time: 0.099416 Jul 21 22:56:51.407960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 248/540] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:51.415417 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.424641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.426147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.427342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d9ff9390-72e0-40f5-b9b6-d35b95805e3c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.159099 Jul 21 22:56:51.427899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 293/541] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:51.940765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-f9c65a0d-2ec5-447a-855b-bce35077049f req-16f1e792-4eaf-4489-b221-a92dcab3a961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "name": "network-vif-plugged", "status": "completed", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:51.948660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-f9c65a0d-2ec5-447a-855b-bce35077049f req-16f1e792-4eaf-4489-b221-a92dcab3a961 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.949096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-f9c65a0d-2ec5-447a-855b-bce35077049f req-16f1e792-4eaf-4489-b221-a92dcab3a961 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.952800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:51.959850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-f9c65a0d-2ec5-447a-855b-bce35077049f req-16f1e792-4eaf-4489-b221-a92dcab3a961 service nova] Creating event network-vif-plugged:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:56:51.964596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-f9c65a0d-2ec5-447a-855b-bce35077049f req-16f1e792-4eaf-4489-b221-a92dcab3a961 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027642 Jul 21 22:56:51.965188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 249/542] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:51.990280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.990921 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 294aeb91-ca3e-45e1-af6f-efe768e62fff] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.996949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.997398 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.998180 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.998614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.011757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] HTTP exception thrown: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Request method failure captured: Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff HTTP/1.1 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlM4vrttaibworC4mD9IJMdzC3LaCP5hgdnxLfiK5oXPIg_Be0Uz19ncUyFvpHZr2mZlb0SCp_nxxjiFBJhHW2Y-udALW00Gz_gvXexsBl7A-cydZbC1F87LPDG8UETgo-g4eXdrA8hPF9u-JxLkZwbM3UuasN_A2_Jt4hmREMQ3HE Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 2822a8cb96b94bf3bf525b0785c36934 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:56:52.013871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2822a8cb96b94bf3bf525b0785c36934", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 2822a8cb96b94bf3bf525b0785c36934 Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesSnapshotTestJSON-370070837-project Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 5eadb243fd6a4517bca72e18dec30e7a Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesSnapshotTestJSON-370070837-project Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. Jul 21 22:56:52.017735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '294aeb91-ca3e-45e1-af6f-efe768e62fff'} Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:56:52.018725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. Jul 21 22:56:52.020065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.021130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Returning 404 to user: Instance 294aeb91-ca3e-45e1-af6f-efe768e62fff could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:56:52.021130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bf3049d8-bf26-46eb-aac7-50ae3bb69105 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff" status: 404 len: 111 microversion: 2.1 time: 0.029797 Jul 21 22:56:52.021130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 294/543] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/294aeb91-ca3e-45e1-af6f-efe768e62fff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:56:52.429977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:52.430733 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] [instance: 8dfdde86-def0-4598-8128-6a93a4410338] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:52.437682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.438128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.439001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.439446 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.445481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:52.446166 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:52.452681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.452824 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] HTTP exception thrown: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. Jul 21 22:56:52.453255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.454160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Request method failure captured: Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 HTTP/1.1 Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dmI5IcaXhkBZ4P1fvnLtgbsL0wqs-csl9ciycsHE10cT15Uiq4Tk8NRvWPjBT9qxY30--einZqgOAd039poIO0l2e3lZhjVqvdkl-mc3XJSzchWrJDMkNR58hwpijuQGbsKwEiPY8ufi_xQiXZqjmSiSch32qHAzmTfQUxqwleHLBQ Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: f64f9241e0da4e8f98fb1ad5b46d836d Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesNegativeTest-1103293483 Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:56:52.454429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f64f9241e0da4e8f98fb1ad5b46d836d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f64f9241e0da4e8f98fb1ad5b46d836d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f64f9241e0da4e8f98fb1ad5b46d836d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f64f9241e0da4e8f98fb1ad5b46d836d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesNegativeTest-1103293483 Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: f64f9241e0da4e8f98fb1ad5b46d836d Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesNegativeTest-1103293483 Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesNegativeTest-1103293483-project Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8677c914de1d4eb1b3e8c36eabbb0ade Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesNegativeTest-1103293483-project Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. Jul 21 22:56:52.456034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '8dfdde86-def0-4598-8128-6a93a4410338'} Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:56:52.456880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. Jul 21 22:56:52.458170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:56:52.460046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.460139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] Returning 404 to user: Instance 8dfdde86-def0-4598-8128-6a93a4410338 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:56:52.460139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b31c1c4f-3748-47cb-8c86-e17127969d54 tempest-VolumesNegativeTest-1103293483 tempest-VolumesNegativeTest-1103293483-project] 10.222.0.52 "GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338" status: 404 len: 111 microversion: 2.1 time: 0.030546 Jul 21 22:56:52.460139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 250/544] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:52 2022] GET /compute/v2.1/servers/8dfdde86-def0-4598-8128-6a93a4410338 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:56:52.461796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:52.596008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.608081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.609744 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.610885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c5490129-1ad1-4f35-8c3b-9ee30c0df25c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.169322 Jul 21 22:56:52.611428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 295/545] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:52 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:53.458419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5dda91ea-3301-48b1-a9e7-7c1fb468a547 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: .version_select at 0x7fc5e44fd5e0>, body: {"keypair": {"name": "tempest-keypair-455663696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW93iEXBSsgTkn5wmHZpN4Yxf/zr2dxGenzOMO2OK+cI0XKu2x0Q4i2JhmMtJBbq+x+VgDaYh/3JyHy8OeQJAyqAkVp9/a/eQi68nqXw4fTIQcVaErMHOkrdp1uOzvd+A=="}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:53.473710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-5dda91ea-3301-48b1-a9e7-7c1fb468a547 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:56:53.477755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-5dda91ea-3301-48b1-a9e7-7c1fb468a547 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:56:53.599146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5dda91ea-3301-48b1-a9e7-7c1fb468a547 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144381 Jul 21 22:56:53.599146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 251/546] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:56:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:53.630416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:53.631061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:53.638080 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:53.638531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:53.639835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:53.640277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:53.783720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.792300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.793968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.795143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-40fdc841-2f37-49c5-9f2d-ad20a33294d7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.169793 Jul 21 22:56:53.796377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 296/547] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:53 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:54.814430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:54.815074 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:54.824094 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.824930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.825886 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.826329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.208165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:55.216868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:55.218374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:55.219568 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2dd98f33-29f2-485c-bdc1-71882fd4131f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.410052 Jul 21 22:56:55.220135 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 252/548] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:54 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:56.213358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1532424279", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be9945ce-a7e9-414b-b532-8c7c706d9d8c"}], "security_groups": [{"name": "tempest-securitygroup--1136763559"}], "key_name": "tempest-keypair-455663696", "user_data": "}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:56.238252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:56.239070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:56.246759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.247497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.248692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.249760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.340698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] validate_networks() for [('be9945ce-a7e9-414b-b532-8c7c706d9d8c', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:56:56.403181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.413400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.414115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.415323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e46650ec-8885-45c3-8cf4-dce904736325 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.181119 Jul 21 22:56:56.427074 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 253/549] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:56 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:56.735907 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:56:56.736334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:56:56.736809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:56:56.737212 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:56:56.737632 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:56:56.747745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.748250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.749269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.749709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.766992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:56:56.771007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:56:56.782602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:56:56.784839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:56:56.958389 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-658657ee-3686-4e81-b351-d0a3da783fac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749209 Jul 21 22:56:56.959359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 297/550] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:56:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:56:56.973882 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5a51ac56-54c9-4e5e-b75c-228ba49a06b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:56.976251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5a51ac56-54c9-4e5e-b75c-228ba49a06b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:57.035216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5a51ac56-54c9-4e5e-b75c-228ba49a06b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.042252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5a51ac56-54c9-4e5e-b75c-228ba49a06b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1241 microversion: 2.1 time: 0.076705 Jul 21 22:56:57.042849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 254/551] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:56 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:57.434663 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:57.435296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:57.443007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.443458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.444219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.444652 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.591567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.602361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.603838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.604993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f7c3ba45-741c-447d-abd9-baeb4afe9a4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.174788 Jul 21 22:56:57.605532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 298/552] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:57 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:58.059221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:58.059984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:58.066530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.067018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.067779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.068213 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.132420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:58.141438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0c814d7c-a5ad-4fab-a30e-3c5dc10e889d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1245 microversion: 2.1 time: 0.085006 Jul 21 22:56:58.141438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 255/553] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:58 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:58.623374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:58.624668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:58.631899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.632282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.633113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.633537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.766868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:58.775920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:58.777629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:58.779002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ab308a94-cff8-40c5-a139-eb8828031806 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.159902 Jul 21 22:56:58.779564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 299/554] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:58 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:59.157573 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:59.158129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:59.164653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:59.165100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:59.165845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:59.166273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:59.228840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.237129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6abc5e24-3efe-473a-ac95-3368de365c13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1293 microversion: 2.1 time: 0.083815 Jul 21 22:56:59.237714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 256/555] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:59 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:59.797295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:59.798013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:59.804528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:59.804952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:59.808791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:59.808791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:59.980147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.989098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.990592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.991782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-57f0fd40-60e0-4088-b3d4-ccc94b25e875 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.198415 Jul 21 22:56:59.992338 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 300/556] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:59 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:57:00.258549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:00.259742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:00.271351 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.272178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.273576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.274390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.340084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:00.348204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3a25ff56-a9a1-4f44-b41f-d8efc953ce3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1293 microversion: 2.1 time: 0.097107 Jul 21 22:57:00.348778 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 257/557] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:00 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:01.010349 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:01.011108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:01.018005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.019112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.020071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.020755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.169237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.178354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.180159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.181420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ed1f81f-1b33-4a71-a8a9-97da5ff6d620 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1809 microversion: 2.20 time: 0.175052 Jul 21 22:57:01.182082 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 301/558] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:01 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:57:01.365107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:01.365625 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:01.372143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.386137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.386137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.386137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.439491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.452825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4b86f25f-6966-43c1-aed8-1a35e6e901b3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1301 microversion: 2.1 time: 0.091019 Jul 21 22:57:01.453422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 258/559] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:01 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:02.199902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:02.201123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:02.207933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.208772 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.209607 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.210273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.416530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.427072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.428991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.430277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-39c94287-0054-43a3-9b80-2bf5d914acfa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1796 microversion: 2.20 time: 0.234396 Jul 21 22:57:02.431107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 302/560] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:02 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1796 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:57:02.486150 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:02.487534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:02.516691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.517153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.517950 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.519259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.709206 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.722028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-56d7c848-3bb5-4c4d-b986-0bb56c5353ca tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.246132 Jul 21 22:57:02.722028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 259/561] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:02 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:02.727309 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-777423450", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "networks": [{"uuid": "4023a2a0-6b6a-4e8b-9d74-f0c3f22b1520"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:02.790318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] validate_networks() for [('4023a2a0-6b6a-4e8b-9d74-f0c3f22b1520', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:57:03.387284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:57:03.392519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:57:03.392519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:57:03.392519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:57:03.392519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:57:03.400048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.400947 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.402627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.403312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.429734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Getting quotas for project 2822a8cb96b94bf3bf525b0785c36934. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:57:03.431379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Getting quotas for user 5eadb243fd6a4517bca72e18dec30e7a and project 2822a8cb96b94bf3bf525b0785c36934. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:57:03.443523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:57:03.446592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:57:03.580982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-439b8904-745f-409e-8ef5-31a47343b256 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857883 Jul 21 22:57:03.582697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 303/562] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:57:03.593086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d2a60f8b-c002-4120-9313-de35e72fb6b8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:03.593702 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d2a60f8b-c002-4120-9313-de35e72fb6b8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:03.668924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d2a60f8b-c002-4120-9313-de35e72fb6b8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:03.681302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d2a60f8b-c002-4120-9313-de35e72fb6b8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1218 microversion: 2.1 time: 0.093059 Jul 21 22:57:03.690492 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 260/563] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:03 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:03.738675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:03.739554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:03.749276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.750007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.751136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.762705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.893374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-352e838c-e5cd-427b-a774-8d999914c595 req-ba105889-7dda-4529-b679-b5aaf6198328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a2b99f-a099-4b41-8f45-90670baf9a15", "tag": "33a5af80-6fed-4810-81a0-1d24345dfa04"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:03.915359 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-352e838c-e5cd-427b-a774-8d999914c595 req-ba105889-7dda-4529-b679-b5aaf6198328 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.916226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-352e838c-e5cd-427b-a774-8d999914c595 req-ba105889-7dda-4529-b679-b5aaf6198328 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.929977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-352e838c-e5cd-427b-a774-8d999914c595 req-ba105889-7dda-4529-b679-b5aaf6198328 service nova] Creating event network-changed:33a5af80-6fed-4810-81a0-1d24345dfa04 for instance a0a2b99f-a099-4b41-8f45-90670baf9a15 on hv-cinder-85069 Jul 21 22:57:03.935182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-352e838c-e5cd-427b-a774-8d999914c595 req-ba105889-7dda-4529-b679-b5aaf6198328 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046799 Jul 21 22:57:03.937151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 261/564] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:57:04.062895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:04.074639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e9f6720d-2949-4c1a-9590-4598fe2d7470 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.341347 Jul 21 22:57:04.085726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 304/565] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:03 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:04.708390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:04.709078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:04.715481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.715908 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.716671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.717107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.796906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:04.808799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-271a5f5a-5999-40cf-87a6-a481a48a31cc tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1222 microversion: 2.1 time: 0.104882 Jul 21 22:57:04.810902 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 262/566] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:04 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:05.091809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:05.092961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:05.095541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:05.102240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.102633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:05.103846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.104293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:05.274536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:05.283589 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ebe2e730-d514-4cb1-a2a0-7f24914b00bd tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.194724 Jul 21 22:57:05.283589 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 305/567] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:05 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:05.828218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:05.829124 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:05.836022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.836872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:05.837696 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.838132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:05.910826 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:05.918538 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-87f36cf1-6e02-40ab-9e21-96e0c4e9b661 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1214 microversion: 2.1 time: 0.094604 Jul 21 22:57:05.919153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 263/568] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:05 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:06.303155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:06.303783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:06.312707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.312707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.312707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.312707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.460145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:06.468959 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-66f9d9c0-cc58-4f0f-a1e1-ad6561c8f48e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.169660 Jul 21 22:57:06.473393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 306/569] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:06 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:06.937687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:06.938296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:06.948091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.948547 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.949324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.949752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.047027 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:07.056743 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-031235ab-156f-4e36-985d-5602003aa3f6 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1278 microversion: 2.1 time: 0.123515 Jul 21 22:57:07.057480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 264/570] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:06 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:07.490855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:07.492131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:07.499130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.502112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.502112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.502112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.675060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:07.683103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f099b664-69b9-4bfa-981b-1b0ba68569d3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.196941 Jul 21 22:57:07.693640 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 307/571] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:07 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:08.074656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:08.075331 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:08.085024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.085487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.086273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.086722 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.403244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:08.417102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ee9caa75-7156-4972-903e-492b5cc00f01 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.345723 Jul 21 22:57:08.418489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 265/572] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:08 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:08.700529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:08.702072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:08.710655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.711145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.711936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.712541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.956159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:08.966277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-be210674-1bad-407d-8d6c-955290a35916 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.266135 Jul 21 22:57:08.966991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 308/573] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:08 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:09.436046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:09.437642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:09.440416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:09.454972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.455953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.456890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.457457 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.844179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:09.854234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-45856c5d-d1e4-4f66-a483-77ca1f795785 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.423028 Jul 21 22:57:09.869932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 266/574] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:09 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:09.985625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:09.986801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:09.994811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.995557 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.997456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.997456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.192625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:10.206902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f858093d-92e5-43d4-b530-39fea885080a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.225506 Jul 21 22:57:10.208499 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 309/575] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:09 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:10.274520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-654b740b-9d7c-40d3-8d2c-aefc20e74460 req-bac3c151-73c0-473d-94bc-bca563dd1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965d5fa6-dec4-45e7-8e07-db1507b20ddc", "tag": "fe9a0edb-bd94-4e96-94e4-02d10d0624fb"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:10.284301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-654b740b-9d7c-40d3-8d2c-aefc20e74460 req-bac3c151-73c0-473d-94bc-bca563dd1ebe service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.285119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-654b740b-9d7c-40d3-8d2c-aefc20e74460 req-bac3c151-73c0-473d-94bc-bca563dd1ebe service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.297763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-654b740b-9d7c-40d3-8d2c-aefc20e74460 req-bac3c151-73c0-473d-94bc-bca563dd1ebe service nova] Creating event network-changed:fe9a0edb-bd94-4e96-94e4-02d10d0624fb for instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc on hv-cinder-85069 Jul 21 22:57:10.306086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-654b740b-9d7c-40d3-8d2c-aefc20e74460 req-bac3c151-73c0-473d-94bc-bca563dd1ebe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035542 Jul 21 22:57:10.308254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 267/576] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:57:10.407679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-4c2c00a3-4941-448e-acfe-9ab6a2807e89 req-8929d44f-0e0e-4265-abda-e005dacbdded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a2b99f-a099-4b41-8f45-90670baf9a15", "name": "network-vif-plugged", "status": "completed", "tag": "33a5af80-6fed-4810-81a0-1d24345dfa04"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:10.418907 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4c2c00a3-4941-448e-acfe-9ab6a2807e89 req-8929d44f-0e0e-4265-abda-e005dacbdded service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.419712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-4c2c00a3-4941-448e-acfe-9ab6a2807e89 req-8929d44f-0e0e-4265-abda-e005dacbdded service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.434879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-4c2c00a3-4941-448e-acfe-9ab6a2807e89 req-8929d44f-0e0e-4265-abda-e005dacbdded service nova] Creating event network-vif-plugged:33a5af80-6fed-4810-81a0-1d24345dfa04 for instance a0a2b99f-a099-4b41-8f45-90670baf9a15 on hv-cinder-85069 Jul 21 22:57:10.441352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-4c2c00a3-4941-448e-acfe-9ab6a2807e89 req-8929d44f-0e0e-4265-abda-e005dacbdded service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039171 Jul 21 22:57:10.442385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 310/577] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:10.872595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:10.873526 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:10.880259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.880727 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.881501 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.881930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.108313 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:11.116650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e71387c2-7030-4a16-89f5-6ef6866774e5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.248497 Jul 21 22:57:11.117685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 268/578] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:10 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:11.226281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:11.227078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:11.234017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.234565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.235452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.235944 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.410722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:11.420592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1ce0f486-9280-457e-ab68-fa35602c9e77 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.199222 Jul 21 22:57:11.427374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 311/579] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:11 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:12.134288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:12.135648 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:12.142594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.146996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:12.146996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.146996 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:12.302268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:12.311353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-15b22dd9-95bb-41ce-81b0-1343432e448e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.180822 Jul 21 22:57:12.313583 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 269/580] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:12 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:12.439160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:12.439775 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:12.446506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.447036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:12.447825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.448247 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:12.906110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:12.914190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e724870f-67c5-480f-9834-8ada2805ddd4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1367 microversion: 2.1 time: 0.478923 Jul 21 22:57:12.914809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 312/581] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:12 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:13.330022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:13.331647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:13.342122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.343247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.347403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.348034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.580907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:13.589342 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-197474de-8598-4920-a3da-23b28aaf17b9 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.264977 Jul 21 22:57:13.607305 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 270/582] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:13 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:13.931495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:13.932368 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:13.935352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=4 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:13.936098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=12 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:13.941094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.941667 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.942806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.943341 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.123489 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:14.125459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:14.129806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8dd782b8-1472-474c-a0b6-03b48890b215 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1557 microversion: 2.1 time: 0.202475 Jul 21 22:57:14.130381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 313/583] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:13 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1557 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:14.147384 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:14.147878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:14.149819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=8 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:14.154550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.155171 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.157989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.157989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.172679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:14.185425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:14.187001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:14.192567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.193021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.193801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.194237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.247378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-58489cb5-995b-444e-b52d-c4e46cc413fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102296 Jul 21 22:57:14.247378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 271/584] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:57:14 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:14.322096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lazy-loading 'services' on Instance uuid 9b3363b2-6211-444c-8595-b3a40ce92109 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:57:14.585387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6a30984a-0ad6-4c4c-987d-9bae3cb889d5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments/5051eb90-bedb-4d1c-ae57-607bac1373d8" status: 202 len: 0 microversion: 2.1 time: 0.403988 Jul 21 22:57:14.586016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 314/585] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:57:14 2022] DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments/5051eb90-bedb-4d1c-ae57-607bac1373d8 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:57:14.607698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:14.608102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:14.617273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.617721 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.618498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.618973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.847595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:14.864662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-83d9b46b-659c-497e-8832-c68c94d7603e tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.259594 Jul 21 22:57:14.865800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 272/586] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:14 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:15.666161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-35d4ca89-7189-477c-993f-467dec84f602 req-8b90a7db-891f-4b2a-93c2-5616f112877b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a2b99f-a099-4b41-8f45-90670baf9a15", "tag": "33a5af80-6fed-4810-81a0-1d24345dfa04"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:15.679393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-35d4ca89-7189-477c-993f-467dec84f602 req-8b90a7db-891f-4b2a-93c2-5616f112877b service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.680286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-35d4ca89-7189-477c-993f-467dec84f602 req-8b90a7db-891f-4b2a-93c2-5616f112877b service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.696777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-35d4ca89-7189-477c-993f-467dec84f602 req-8b90a7db-891f-4b2a-93c2-5616f112877b service nova] Creating event network-changed:33a5af80-6fed-4810-81a0-1d24345dfa04 for instance a0a2b99f-a099-4b41-8f45-90670baf9a15 on hv-cinder-85069 Jul 21 22:57:15.707921 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-35d4ca89-7189-477c-993f-467dec84f602 req-8b90a7db-891f-4b2a-93c2-5616f112877b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046888 Jul 21 22:57:15.713330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 315/587] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:15.881623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:15.882821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:15.899322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.900160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.901201 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.901903 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.302523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:16.321811 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e5e6a58d-86eb-4c1c-97a8-95959476a15f tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.442051 Jul 21 22:57:16.322423 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 273/588] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:15 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:16.824229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-176c9939-a021-4c1a-9b11-080ed00a8412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:16.832196 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-176c9939-a021-4c1a-9b11-080ed00a8412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.834940 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-176c9939-a021-4c1a-9b11-080ed00a8412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.860673 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-176c9939-a021-4c1a-9b11-080ed00a8412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Going to try to stop instance {{(pid=124925) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 22:57:16.943760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-6fd4a0f7-0155-45f2-a2e8-024d0e525c04 req-82770856-a9fe-47de-815a-98742dae6d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965d5fa6-dec4-45e7-8e07-db1507b20ddc", "name": "network-vif-plugged", "status": "completed", "tag": "fe9a0edb-bd94-4e96-94e4-02d10d0624fb"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:16.956704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6fd4a0f7-0155-45f2-a2e8-024d0e525c04 req-82770856-a9fe-47de-815a-98742dae6d1d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.961401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6fd4a0f7-0155-45f2-a2e8-024d0e525c04 req-82770856-a9fe-47de-815a-98742dae6d1d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.996141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-6fd4a0f7-0155-45f2-a2e8-024d0e525c04 req-82770856-a9fe-47de-815a-98742dae6d1d service nova] Creating event network-vif-plugged:fe9a0edb-bd94-4e96-94e4-02d10d0624fb for instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc on hv-cinder-85069 Jul 21 22:57:17.009244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-6fd4a0f7-0155-45f2-a2e8-024d0e525c04 req-82770856-a9fe-47de-815a-98742dae6d1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069032 Jul 21 22:57:17.013620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 274/589] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:57:17.061065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-176c9939-a021-4c1a-9b11-080ed00a8412 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action" status: 202 len: 0 microversion: 2.1 time: 0.232741 Jul 21 22:57:17.065135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 316/590] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:57:16 2022] POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:57:17.076354 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:17.078324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:17.085514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.089519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.089519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.095279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.265822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:17.277143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e3043e69-ee42-4519-b0bf-b985614d3b70 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.205053 Jul 21 22:57:17.279306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 275/591] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:17 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:17.339746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:17.340807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:17.352092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.352558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.355606 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.371099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.630688 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:17.638619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-76f040ad-8da9-4dc1-8142-937573fe31e4 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.303032 Jul 21 22:57:17.640086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 317/592] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:17 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:18.298667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:18.299909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:18.309008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.309544 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.312560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.313367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.512440 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:18.520920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4afcef3e-6a71-4c41-848a-44389f32a667 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.228895 Jul 21 22:57:18.521725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 276/593] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:18 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:18.656926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:18.657574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:18.664382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.664836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.665758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.666191 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.811721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:18.819692 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-12ad8c93-5083-4104-9c80-0b54b54254f2 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.166845 Jul 21 22:57:18.820296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 318/594] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:18 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:19.540459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:19.541630 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:19.548862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.549488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.550559 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.551028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.695107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:19.704067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-181c355a-d22b-4c69-ad2f-c14e0ac5f7d7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.168886 Jul 21 22:57:19.705449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 277/595] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:19 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:19.837418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:19.841163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:19.849562 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.850149 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.851289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.852006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.997950 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:20.007081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d92ab1e8-d4ed-46d4-a738-5bc232d11b7a tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1318 microversion: 2.1 time: 0.173678 Jul 21 22:57:20.016468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 319/596] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:19 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:20.721275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:20.722715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:20.729469 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:20.730002 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:20.730906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:20.731418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:20.888606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:20.902208 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5d7b14b7-e98c-4ecc-97d7-57ca79ef3102 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.185370 Jul 21 22:57:20.903975 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 278/597] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:20 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:21.024264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:21.025579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:21.033696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.033696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.034362 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.034818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.196409 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:21.205542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-499c1bfc-93d7-4a29-af25-284013bba6d5 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1507 microversion: 2.1 time: 0.185273 Jul 21 22:57:21.206332 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 320/598] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:21 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:21.226016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfd3248e-0590-40ad-9780-fc9028d9e7f3", "device": "/dev/sdb"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:21.227206 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:21.234628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.235116 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.235958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.236315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.919828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:21.920442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:21.927387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.927831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.928608 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.929037 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:22.074556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:22.083361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bd1acf9d-a3ab-424c-8f16-34bb0e10292c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.167709 Jul 21 22:57:22.136167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 321/599] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:21 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:22.198367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b5afff57-30c1-4bf0-906c-500516760917 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "POST /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977023 Jul 21 22:57:22.216229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 279/600] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:57:21 2022] POST /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:23.101711 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:23.102912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:23.110509 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.111047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.111871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.112458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.265964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:23.268649 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-758a70e6-ace5-49ff-a2b8-52defc05b822 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.170789 Jul 21 22:57:23.269501 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 322/601] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:23 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:24.290428 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cce434a0-afcc-430f-b445-ddbe5b9e9dc7"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:24.292478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:24.293543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:24.298678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:24.305103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.305865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.306282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.306703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.307343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.307844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.307977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.308621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.461833 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:24.470213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-757d23ba-ffb7-4531-9c09-1a4a254b5c79 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.188107 Jul 21 22:57:24.470818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 323/602] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:24 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:25.116287 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5a1073fe-37a1-4a34-935e-a3b615b2b18c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829829 Jul 21 22:57:25.116904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 280/603] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:57:24 2022] POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:25.488252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:25.488852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:25.496244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.496936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:25.498411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.498866 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:25.648757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:25.659030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-62da998b-f44c-4e42-b4d9-1cfc622fe71b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.175152 Jul 21 22:57:25.659615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 324/604] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:25 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:26.312589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-35346b16-9745-4fa8-a27d-75bc585f2e09 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'create', calling method: .version_select at 0x7fc5e44eab80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1619366543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbzQRLOe6GNcYddGPiJVuTyymOs93zS7RheVrJPD8k9XiBtkgxXx/jAo+ycyHZXTyspR6OR4+yR9Pdmz0tup7G1+zs39z6clxJz1Ig8R4hyJ0IvKyKgZnTWIyguDnaRjw=="}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:26.326275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-35346b16-9745-4fa8-a27d-75bc585f2e09 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Getting quotas for project 5dbf5236757941d6b4db3517e1757621. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:57:26.330058 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-35346b16-9745-4fa8-a27d-75bc585f2e09 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Getting quotas for user 257adcc88884437eb740f78dbd9e19c2 and project 5dbf5236757941d6b4db3517e1757621. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:57:26.429669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-35346b16-9745-4fa8-a27d-75bc585f2e09 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.121699 Jul 21 22:57:26.430195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 281/605] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:57:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:26.481264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1415797750", "imageRef": "449cbd31-8c07-4b19-9f5b-8a0dd9419e5e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1619366543", "networks": [{"uuid": "d089b5b3-1f4f-4ee0-b5ea-996775bbc10a"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:26.534601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] validate_networks() for [('d089b5b3-1f4f-4ee0-b5ea-996775bbc10a', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:57:26.676295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:26.677142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:26.683545 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.684050 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.684820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.685253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.818106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:26.826045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-02ce5ba7-68a5-431e-a919-e2c2546ed363 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1679 microversion: 2.1 time: 0.153789 Jul 21 22:57:26.826694 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 282/606] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:26 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:26.904358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:57:26.904776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:57:26.905245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:57:26.905646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:57:26.906084 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:57:26.914654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.915126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.915923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.916352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.932464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Getting quotas for project 5dbf5236757941d6b4db3517e1757621. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:57:26.936414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Getting quotas for user 257adcc88884437eb740f78dbd9e19c2 and project 5dbf5236757941d6b4db3517e1757621. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:57:26.947471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:57:26.949592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='449cbd31-8c07-4b19-9f5b-8a0dd9419e5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:57:27.111865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c0e1e3e4-7065-4257-b399-26af760d03e7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635938 Jul 21 22:57:27.112521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 325/607] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:57:27.122727 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-94b4ee6f-e106-4fcb-a516-1469a521ca03 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:27.123356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-94b4ee6f-e106-4fcb-a516-1469a521ca03 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:27.179757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-94b4ee6f-e106-4fcb-a516-1469a521ca03 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:27.186921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-94b4ee6f-e106-4fcb-a516-1469a521ca03 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1259 microversion: 2.1 time: 0.068096 Jul 21 22:57:27.188731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 283/608] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:27 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:27.844995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:27.845679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:27.853499 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:27.854143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:27.855105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:27.855534 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:27.987411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:27.994902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-efb34698-e7e8-405f-b8f1-526f3b66c93c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1656 microversion: 2.1 time: 0.154783 Jul 21 22:57:27.995483 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 326/609] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:27 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:28.013627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-80608037-b3be-4276-b12f-cb90ecadb6cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:28.020227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80608037-b3be-4276-b12f-cb90ecadb6cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.020695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80608037-b3be-4276-b12f-cb90ecadb6cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.079462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-80608037-b3be-4276-b12f-cb90ecadb6cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Going to try to start instance {{(pid=124924) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 22:57:28.204514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:28.205069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:28.211054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.211495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.212255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.212685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.271877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-80608037-b3be-4276-b12f-cb90ecadb6cf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action" status: 202 len: 0 microversion: 2.1 time: 0.263576 Jul 21 22:57:28.272322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 284/610] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:57:28 2022] POST /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:57:28.275388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:28.280877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:28.282055 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:28.283354 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-63162672-4fb9-48f3-a692-84cb146bee2e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1263 microversion: 2.1 time: 0.082715 Jul 21 22:57:28.284113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 327/611] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:28 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:28.288689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.289131 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.289901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.290337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.429423 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:28.436907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-dbec5505-711b-4017-9827-b3680ea8e47b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1665 microversion: 2.1 time: 0.160224 Jul 21 22:57:28.437517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 285/612] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:28 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:29.301002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:29.301608 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:29.308057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.308507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.309265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.309699 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.373336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:29.380880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a371c933-de04-4468-9d6c-67f593cf6fa4 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1311 microversion: 2.1 time: 0.084334 Jul 21 22:57:29.381455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 328/613] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:29 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:29.454618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:29.455254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:29.461643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.462093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.462894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.463326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.593953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:29.602306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f7c6c8c6-3f0b-44cb-9f33-c1c224e639a6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1665 microversion: 2.1 time: 0.151967 Jul 21 22:57:29.602896 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 286/614] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:29 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:30.398287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:30.400479 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:30.408412 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.408941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.409768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.410273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.481366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:30.492962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0c93c4e3-f907-4b40-9640-733754d16746 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1329 microversion: 2.1 time: 0.095325 Jul 21 22:57:30.492962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 329/615] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:30 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:30.619041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:30.619643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:30.626804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.627366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.628132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.628559 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.646870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:30.831007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:30.839184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3ee58d43-c7f3-4a1a-996b-e845babb043c tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1665 microversion: 2.1 time: 0.223959 Jul 21 22:57:30.840276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 287/616] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:30 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1665 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:31.508624 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:31.510090 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:31.519013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.519758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.520683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.521445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.526269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:31.667436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:31.675834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0823adf5-12b7-41a9-b119-901769a86e8f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.171541 Jul 21 22:57:31.676425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 330/617] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:31 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:31.857252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:31.858755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:31.867589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.868475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.869582 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.870099 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.012491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:32.021200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-da180b3f-4b78-4db4-ac00-deb7c1669fdf tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1669 microversion: 2.1 time: 0.167487 Jul 21 22:57:32.021843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 288/618] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:31 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:32.693975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:32.694687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:32.702116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.702552 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.703342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.703769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.840662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:32.848681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-78a7f6a5-c68e-4d89-9fe8-b56a5c0fe082 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.158798 Jul 21 22:57:32.849345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 331/619] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:32 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:33.866815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:33.867366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:33.877596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.878052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:33.878866 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.879310 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:34.023252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:34.031054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2139a961-2924-43bc-a048-531aa55612e9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.168442 Jul 21 22:57:34.041309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 289/620] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:33 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:35.048420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:35.048932 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:35.055459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.055898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.056655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.057070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.194002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:35.201697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-861f6031-ed32-4a71-81f4-b4dadc2383f1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.157720 Jul 21 22:57:35.202287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 332/621] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:35 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:36.218801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:36.219633 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:36.226669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.227214 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.228052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.228566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.364483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:36.373172 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-beb18b51-1419-46d7-893c-dd1e430cf197 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.158081 Jul 21 22:57:36.373838 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 290/622] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:36 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:37.392235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:37.392915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:37.395328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:37.396037 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:37.396975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:37.401902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.408767 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.408767 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.408767 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.552390 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:37.560018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c175382c-0a1d-4585-8be2-c1652372162c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.172523 Jul 21 22:57:37.560816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 333/623] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:37 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:38.577332 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:38.578090 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:38.579968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=6 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:38.585453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.585926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.586681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.587147 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.716397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:38.724006 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-59c4fd46-e17e-4907-88bc-34499f73241b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.150561 Jul 21 22:57:38.724573 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 291/624] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:38 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:39.741575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:39.742177 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:39.748882 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.749334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.750121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.750543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.895305 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:39.905254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-47eda22f-cd5d-4ad1-8741-d7457ce8e54b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.167519 Jul 21 22:57:39.915614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 334/625] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:39 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:40.923550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:40.924140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:40.926469 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:40.931481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:40.931930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:40.932877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:40.933334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:41.087096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:41.095856 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8a6df350-6e43-4dc9-a8e5-1563589d38d9 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.176637 Jul 21 22:57:41.103385 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 292/626] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:40 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:42.112937 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:42.113541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:42.120265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.120706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.121462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.121891 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.259764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:42.267598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ed3a7778-68d5-4950-9fbd-1dc7155981ed tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.158424 Jul 21 22:57:42.268185 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 335/627] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:42 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:42.879271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-e7d1367c-b932-4e42-9d89-4c04dfee1312 req-df85dba1-0593-463e-a580-ded9407d4aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:42.887938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e7d1367c-b932-4e42-9d89-4c04dfee1312 req-df85dba1-0593-463e-a580-ded9407d4aac service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.888414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e7d1367c-b932-4e42-9d89-4c04dfee1312 req-df85dba1-0593-463e-a580-ded9407d4aac service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.905999 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-e7d1367c-b932-4e42-9d89-4c04dfee1312 req-df85dba1-0593-463e-a580-ded9407d4aac service nova] Creating event network-changed:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 22:57:42.909251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-e7d1367c-b932-4e42-9d89-4c04dfee1312 req-df85dba1-0593-463e-a580-ded9407d4aac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Jul 21 22:57:42.910032 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 293/628] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:43.291556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:43.292151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:43.299842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.300291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.301096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.301865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.444741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:43.452258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-27e71ff0-ebf1-4dca-814c-0db72d3122ec tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.170377 Jul 21 22:57:43.452841 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 336/629] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:43 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:43.867991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:43.868564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:43.874676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.875851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.876591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.877033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.998227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lazy-loading 'services' on Instance uuid 965d5fa6-dec4-45e7-8e07-db1507b20ddc {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:57:44.273416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-466bb6e6-1a4d-48e7-9a73-9c5dcc54f4ff tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "DELETE /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc/os-volume_attachments/dfd3248e-0590-40ad-9780-fc9028d9e7f3" status: 202 len: 0 microversion: 2.1 time: 0.409482 Jul 21 22:57:44.274013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 294/630] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:57:43 2022] DELETE /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc/os-volume_attachments/dfd3248e-0590-40ad-9780-fc9028d9e7f3 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:57:44.469274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:44.470449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:44.477194 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.477648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.478408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.478864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.606456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:44.613844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-aa6a86b3-495c-4b46-aab0-bc2dc593db62 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.148454 Jul 21 22:57:44.614405 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 337/631] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:44 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:45.632296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:45.633024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:45.639284 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.639730 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.640486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.640920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.766693 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:45.774514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9fa03cba-1cd4-431e-8897-4d96055ecabe tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.146924 Jul 21 22:57:45.775177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 295/632] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:45 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:46.793969 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:46.794603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:46.803811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.804267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.805093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.805534 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.948560 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:46.956425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3915a34a-9200-41c6-ae01-1bc33bf45a42 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.169209 Jul 21 22:57:46.956993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 338/633] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:46 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:47.974142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:47.974735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:47.981466 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:47.981922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:47.982695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:47.983212 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:48.118421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:48.126387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7c245b66-2d51-4831-a793-cbd2202e4e38 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.156308 Jul 21 22:57:48.126992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 296/634] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:47 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:48.276184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-9fad9dc6-3205-4b0d-b365-39376b6ef9c8 req-0c4534ac-8ad0-41b6-b736-d733328a8752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "name": "network-vif-plugged", "status": "completed", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:48.284818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-9fad9dc6-3205-4b0d-b365-39376b6ef9c8 req-0c4534ac-8ad0-41b6-b736-d733328a8752 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:48.285260 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-9fad9dc6-3205-4b0d-b365-39376b6ef9c8 req-0c4534ac-8ad0-41b6-b736-d733328a8752 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:48.296155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-9fad9dc6-3205-4b0d-b365-39376b6ef9c8 req-0c4534ac-8ad0-41b6-b736-d733328a8752 service nova] Creating event network-vif-plugged:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 22:57:48.301769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-9fad9dc6-3205-4b0d-b365-39376b6ef9c8 req-0c4534ac-8ad0-41b6-b736-d733328a8752 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029443 Jul 21 22:57:48.302353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 339/635] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:49.143491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:49.144101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:49.150663 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.151867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.152128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.152438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.283071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:49.290410 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fa888350-2c5b-4f77-bfbe-a59163cf5050 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.151439 Jul 21 22:57:49.291015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 297/636] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:49 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:49.561559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:49.562586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:49.569750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.570201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.571000 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.571444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.594264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lazy-loading 'flavor' on Instance uuid 1eaf8f01-0480-4896-bcb0-e1815f7ace90 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:57:49.918301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a71702f4-8246-498d-b726-69beb518e73b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/action" status: 200 len: 32 microversion: 2.1 time: 0.361090 Jul 21 22:57:49.918936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 340/637] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:57:49 2022] POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:57:49.928607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:49.929213 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:49.935220 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.935670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.936440 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.936883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.071539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:50.079546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7c0b47f4-3535-4989-9bcd-ce7e209e6180 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.154788 Jul 21 22:57:50.080120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 298/638] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:49 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:50.309126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:50.309826 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:50.316205 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.316653 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.317429 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.317872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.450333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:50.458403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2a41fa5b-fd04-4cc2-af98-dd5682ae5cc6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.153659 Jul 21 22:57:50.459108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 341/639] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:50 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:50.654079 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:50.655082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:50.661610 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.662060 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.662847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.663282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.688026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:57:50.937112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-18ed4617-a8e2-4f5c-8678-95d388f1a591 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "DELETE /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 204 len: 0 microversion: 2.1 time: 0.286669 Jul 21 22:57:50.937734 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 299/640] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:57:50 2022] DELETE /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:57:50.945790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:50.951178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:50.952888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.953338 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.954102 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.954567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.086356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:51.094749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d8c27663-8a72-48fd-96a3-ec72865b2941 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1513 microversion: 2.1 time: 0.152769 Jul 21 22:57:51.095338 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 342/641] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:50 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:51.097992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.098688 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.104729 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.105296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.105980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.106416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.240691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:51.248803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5520bb28-3280-4410-a2c2-b47583664b00 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.155701 Jul 21 22:57:51.249374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 300/642] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:51.339721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.340198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.346215 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.346654 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.347431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.348112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.375493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c839a16a-5853-44f0-8fa4-fe3297646441 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments/d01bfc63-9604-4362-bec9-64c1a4752cdc" status: 200 len: 194 microversion: 2.20 time: 0.039967 Jul 21 22:57:51.376773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 343/643] 10.222.0.52 () {60 vars in 1453 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments/d01bfc63-9604-4362-bec9-64c1a4752cdc => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:57:51.437129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.437621 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.444120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.444570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.445338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.445775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.475699 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.476301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.482800 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.483302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.484825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.484825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.526968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lazy-loading 'services' on Instance uuid 5f228a73-c5cf-494a-8440-c15567b7618b {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:57:51.619316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:51.626740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3796f322-4f57-4dac-b29f-a8814d1d2b6b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.155276 Jul 21 22:57:51.627324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 344/644] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:51.664569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:51.773414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9a591c84-837a-4318-a227-42d9394a1ff2 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments/d01bfc63-9604-4362-bec9-64c1a4752cdc" status: 202 len: 0 microversion: 2.20 time: 0.340139 Jul 21 22:57:51.774417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 301/645] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jul 21 22:57:51 2022] DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments/d01bfc63-9604-4362-bec9-64c1a4752cdc => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:57:51.783315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.784320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.790398 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.790886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.791647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.792083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.808414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:51.821111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0e69389d-8c75-4285-a08a-f0a8dcbce12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Jul 21 22:57:51.821655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 345/646] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:57:52.113422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.114105 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.120633 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.121076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.121817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.122246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.254192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:52.261645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-23eb1f12-257c-440d-8c6b-fc05c2328ad8 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1513 microversion: 2.1 time: 0.153283 Jul 21 22:57:52.262209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 302/647] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:52.266605 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.267983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.274352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.274821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.275587 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.276021 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.405694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:52.414188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2615a195-4032-4856-a271-ed7f480512fd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.151666 Jul 21 22:57:52.414762 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 346/648] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:52.645354 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.645961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.652019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.652474 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.653292 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.653678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.780398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:52.788279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2646d27f-2a1d-4ca8-8f9a-ac29fb9fbeb8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1359 microversion: 2.1 time: 0.148402 Jul 21 22:57:52.788857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 303/649] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:52.834184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.835295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.841969 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.842414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.843207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.843641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.874691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8b36d5fe-7454-4c15-9092-6b55bf2cf280 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044631 Jul 21 22:57:52.875368 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 347/650] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:57:53.278611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.279260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.285967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.286421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.287219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.287664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.421745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:53.429897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5e6913dd-5c58-4083-ad10-0920efb06a6c tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1513 microversion: 2.1 time: 0.155194 Jul 21 22:57:53.430468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 304/651] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:53.431683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.432280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.439391 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.439816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.440566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.440991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.573054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:53.581132 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-49831305-4b66-4a40-866e-8aaffb2e86a6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.153273 Jul 21 22:57:53.581685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 348/652] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:53.805092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.805615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.812077 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.812533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.813303 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.813741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.888097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.892515 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.895316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.895771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.896540 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.896976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.927653 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b30f1eb7-c5f0-4cc7-bb14-3097d6172d88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043591 Jul 21 22:57:53.928219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 349/653] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:57:53.941620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:53.948918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2b365f9a-55b4-4b62-b407-bd901381425a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1550 microversion: 2.1 time: 0.147815 Jul 21 22:57:53.949470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 305/654] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:53.964661 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.965264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.971831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.972279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.973310 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.973741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.100944 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.108260 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-aba91650-8a51-4f28-91eb-0bad85f1a8da tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1550 microversion: 2.1 time: 0.147460 Jul 21 22:57:54.108814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 350/655] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:54.123894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.127973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.128803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Searching by: {'deleted': False, 'project_id': '5dbf5236757941d6b4db3517e1757621'} {{(pid=124924) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 22:57:54.135447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.135886 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.139645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.139645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.224446 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.multi_cell_list [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124924) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 22:57:54.322456 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ffea2980-e504-4822-95da-8521f56a085e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202410 Jul 21 22:57:54.323070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 306/656] 10.222.0.52 () {58 vars in 1124 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:54.333741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.334461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.340575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.341024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.341794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.342255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.447454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.448060 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.453989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.454440 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.455224 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.455660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.468303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.476160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-32f3a131-08f2-4b5a-8e13-51d174bb68b0 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1550 microversion: 2.1 time: 0.146250 Jul 21 22:57:54.477101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 351/657] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:54.597377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.603408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.603408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.606287 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7ee1eb1f-8c59-49d6-b904-e5340fb24627 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1513 microversion: 2.1 time: 0.162556 Jul 21 22:57:54.607101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 307/658] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:54.611051 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.611508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.612764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.613206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.745908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.754603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6c598167-f8a7-4ad4-9976-e3a14f9fdf4c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.160349 Jul 21 22:57:54.755213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 352/659] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:54.940653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.941843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.948291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.948735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.951789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.951789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.978620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bf1cb7c1-df09-4aa8-ae10-e51f27ba098f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043045 Jul 21 22:57:54.979213 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 308/660] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:57:55.213476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-5e8864d4-b436-41b5-b44b-117d09e0b9ae req-ce1cac6a-73d6-41f8-8afd-0c35fb92f3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965d5fa6-dec4-45e7-8e07-db1507b20ddc", "name": "network-vif-deleted", "tag": "fe9a0edb-bd94-4e96-94e4-02d10d0624fb"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:55.226980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-5e8864d4-b436-41b5-b44b-117d09e0b9ae req-ce1cac6a-73d6-41f8-8afd-0c35fb92f3ba service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.227421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-5e8864d4-b436-41b5-b44b-117d09e0b9ae req-ce1cac6a-73d6-41f8-8afd-0c35fb92f3ba service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.240741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-5e8864d4-b436-41b5-b44b-117d09e0b9ae req-ce1cac6a-73d6-41f8-8afd-0c35fb92f3ba service nova] Creating event network-vif-deleted:fe9a0edb-bd94-4e96-94e4-02d10d0624fb for instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc on hv-cinder-85069 Jul 21 22:57:55.246144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-5e8864d4-b436-41b5-b44b-117d09e0b9ae req-ce1cac6a-73d6-41f8-8afd-0c35fb92f3ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Jul 21 22:57:55.246753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 353/661] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:55.623200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:55.623799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:55.630234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.631000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.631546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.631973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.661909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.662391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.662849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lazy-loading 'fault' on Instance uuid 965d5fa6-dec4-45e7-8e07-db1507b20ddc {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:57:55.705716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eadb243fd6a4517bca72e18dec30e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822a8cb96b94bf3bf525b0785c36934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:55.713162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-50cbf6a7-b43b-434e-a258-6c56c131bd77 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 200 len: 1308 microversion: 2.1 time: 0.093841 Jul 21 22:57:55.713737 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 309/662] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:55 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:55.773044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:55.773740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:55.780230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.785984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.785984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.785984 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.911769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:55.919820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-18bf4a5a-2704-4383-a3a1-d8df31d3553d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.151445 Jul 21 22:57:55.920297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 354/663] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:55 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:55.991651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:55.992615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:55.999036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:55.999484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.000244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.000680 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.029878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6832026b-7211-4492-b696-2abfc851e84c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042239 Jul 21 22:57:56.030433 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 310/664] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 22:57:55 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:56.087617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:56.088110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.093986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.094955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.095725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.096159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.123214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:57:56.411829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d6c8d796-bb07-4b48-89e0-8cd8fe2b7e59 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 204 len: 0 microversion: 2.20 time: 0.327752 Jul 21 22:57:56.412482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 355/665] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 21 22:57:56 2022] DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:57:56.420775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aeb9f1e-ac9e-4944-81a5-f4140399ab1d"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:56.421881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.426524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:56.427238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.428568 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.429022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.429784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.430393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.433372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.433877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.434622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.435069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.577343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:56.585334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:56.586886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:56.588046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b1f01cbb-d5c7-4767-b233-0eeb80b62bc0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.166321 Jul 21 22:57:56.588605 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 356/666] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:56 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:57:56.730218 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:56.730756 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] [instance: 965d5fa6-dec4-45e7-8e07-db1507b20ddc] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.737293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.737743 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.738507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.738986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.752619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] HTTP exception thrown: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Request method failure captured: Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc HTTP/1.1 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlM4vrttaibworC4mD9IJMdzC3LaCP5hgdnxLfiK5oXPIg_Be0Uz19ncUyFvpHZr2mZlb0SCp_nxxjiFBJhHW2Y-udALW00Gz_gvXexsBl7A-cydZbC1F87LPDG8UETgo-g4eXdrA8hPF9u-JxLkZwbM3UuasN_A2_Jt4hmREMQ3HE Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 2822a8cb96b94bf3bf525b0785c36934 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:57:56.754222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2822a8cb96b94bf3bf525b0785c36934", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2822a8cb96b94bf3bf525b0785c36934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 2822a8cb96b94bf3bf525b0785c36934 Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-370070837 Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesSnapshotTestJSON-370070837-project Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 5eadb243fd6a4517bca72e18dec30e7a Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesSnapshotTestJSON-370070837-project Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. Jul 21 22:57:56.755815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '965d5fa6-dec4-45e7-8e07-db1507b20ddc'} Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:57:56.756851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. Jul 21 22:57:56.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:57:56.759644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] Returning 404 to user: Instance 965d5fa6-dec4-45e7-8e07-db1507b20ddc could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:57:56.759644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c4b24063-8ed9-416d-91ef-64e6981bbe29 tempest-VolumesSnapshotTestJSON-370070837 tempest-VolumesSnapshotTestJSON-370070837-project] 10.222.0.52 "GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc" status: 404 len: 111 microversion: 2.1 time: 0.029456 Jul 21 22:57:56.759644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 357/667] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:56 2022] GET /compute/v2.1/servers/965d5fa6-dec4-45e7-8e07-db1507b20ddc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:57:56.937249 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:56.937856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.944397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.944835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.945580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.946012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.075843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.084221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-33bf8911-9670-46ab-95e3-a32350bb11f3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.150863 Jul 21 22:57:57.084780 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 358/668] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:56 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:57.606635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:57.607279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:57.614111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.614563 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.616802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.616802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.750507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.758366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.759934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.761064 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-30833a3c-7804-4c07-8d93-a16cb752329e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.158341 Jul 21 22:57:57.761617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 359/669] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:57 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:57:58.101893 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:58.102547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:58.108942 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.109388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.110172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.110612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.240525 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.249449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-49585698-65e6-4d95-a944-4eb34614931a tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.151600 Jul 21 22:57:58.250099 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 360/670] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:58 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:58.694188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1e12a909-aefb-471b-b81b-ee8a7775b275 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.277244 Jul 21 22:57:58.694940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 311/671] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:57:56 2022] POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 194 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:57:58.779931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:58.784983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:58.790755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.791124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.791895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.792425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.929820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.933453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:58.938879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.940424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.941581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5936181c-d865-49f4-9795-6287bb7025c3 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1724 microversion: 2.20 time: 0.165539 Jul 21 22:57:58.942119 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 361/672] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:58 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:57:59.256389 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-8aef6efa-e114-49f0-b296-4dec90ddd768 req-7ac6b546-c147-42a2-8663-7d6ab9600871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f228a73-c5cf-494a-8440-c15567b7618b", "name": "network-vif-deleted", "tag": "b6018a62-bad9-4d10-af9d-f5d0973eb84a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:57:59.266901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:59.267498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:59.276740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8aef6efa-e114-49f0-b296-4dec90ddd768 req-7ac6b546-c147-42a2-8663-7d6ab9600871 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.280141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.280579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.281343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.281766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.283048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8aef6efa-e114-49f0-b296-4dec90ddd768 req-7ac6b546-c147-42a2-8663-7d6ab9600871 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.305204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-8aef6efa-e114-49f0-b296-4dec90ddd768 req-7ac6b546-c147-42a2-8663-7d6ab9600871 service nova] Creating event network-vif-deleted:b6018a62-bad9-4d10-af9d-f5d0973eb84a for instance 5f228a73-c5cf-494a-8440-c15567b7618b on hv-cinder-85069 Jul 21 22:57:59.313675 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-8aef6efa-e114-49f0-b296-4dec90ddd768 req-7ac6b546-c147-42a2-8663-7d6ab9600871 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067955 Jul 21 22:57:59.314276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 312/673] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:57:59.451286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:59.460549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-731499c5-cb8e-425a-9f83-a70efbfb5b28 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.197435 Jul 21 22:57:59.461128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 362/674] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:59 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:59.961205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:59.962508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:59.968864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.969319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.970093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.970528 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.038875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.047129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.048816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.050452 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2f77fb1b-03c9-4b50-bc58-6ca9c131a15c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1657 microversion: 2.20 time: 0.093250 Jul 21 22:58:00.051118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 313/675] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:57:59 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:00.478949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:00.479618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:00.486809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.487265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.488046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.488479 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.627419 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.635962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ee66367f-f9de-4b71-9404-810bcf936ec0 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.161075 Jul 21 22:58:00.636567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 363/676] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:00 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:01.069143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:01.069744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:01.076295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.076740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.077490 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.077919 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.138173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:01.146145 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:01.147816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:01.148961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-46ced4e9-2c05-4518-87e4-5f31808e860b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1367 microversion: 2.20 time: 0.083741 Jul 21 22:58:01.149515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 314/677] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:01 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:01.653127 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:01.653725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:01.660303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.660745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.661496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.661924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.791627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:01.799843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e107f6c6-e035-46a2-93d9-44c4006e5746 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.150562 Jul 21 22:58:01.800436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 364/678] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:01 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:02.166602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:02.167259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:02.173826 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.174495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.175319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.175738 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.207182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.207629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.208170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lazy-loading 'fault' on Instance uuid 5f228a73-c5cf-494a-8440-c15567b7618b {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:02.248663 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:02.257412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:02.259037 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:02.260206 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1e6d9879-aa88-464e-8edb-1b5a5d54acef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 200 len: 1372 microversion: 2.20 time: 0.097626 Jul 21 22:58:02.260774 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 315/679] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:02 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:02.816161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:02.817047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:02.823541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.825197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.825197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.825197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.959128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:02.976226 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6cefc4fd-c7e9-4494-b415-382caa19856c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.163989 Jul 21 22:58:02.976912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 365/680] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:02 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:03.279188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:03.279801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:03.286863 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:03.287319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:03.288080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:03.288520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:03.303347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b HTTP/1.1 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:58:03.304941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 22:58:03.306323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '5f228a73-c5cf-494a-8440-c15567b7618b'} Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:03.307250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 22:58:03.308396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:03.309460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:03.309460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-54a1efc4-a120-43ea-ab07-4da47229162c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 404 len: 111 microversion: 2.20 time: 0.031053 Jul 21 22:58:03.309460 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 316/681] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:03 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:58:03.316395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c0979aa3-d3dd-4fbd-bf07-55e3eb16f63d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '.version_select at 0x7fc5d72c83a0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:03.320107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c0979aa3-d3dd-4fbd-bf07-55e3eb16f63d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [93d79d09-37ce-49da-aabd-0fd64def7a0a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:58:03.993238 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:03.993841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:03.999889 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.000334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.001658 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.002097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.020231 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:04.136494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:04.144640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8d06ab21-cafe-41e3-bcc6-31810207b07c tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.155262 Jul 21 22:58:04.145216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 317/682] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:03 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:04.327918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0979aa3-d3dd-4fbd-bf07-55e3eb16f63d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [93d79d09-37ce-49da-aabd-0fd64def7a0a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55554. Jul 21 22:58:04.425036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c0979aa3-d3dd-4fbd-bf07-55e3eb16f63d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135871868" status: 204 len: 0 microversion: 2.20 time: 1.113347 Jul 21 22:58:04.425632 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 366/683] 10.222.0.52 () {60 vars in 1261 bytes} [Thu Jul 21 22:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135871868 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:58:05.162308 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:05.163048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:05.164865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:05.170168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.170616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.171430 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.171869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.228955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ed3ae97-fd4c-4fbf-a1f1-83bbf0b67249 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: .version_select at 0x7fc5d7336940>, body: {"keypair": {"name": "tempest-keypair-576003966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhiMCBFGYQ07vg+TvA+s+yDOi/QZKxHMviQL7LQgbtyoKJvIZRMEZknVnNfh6z2mLfztpweLLa9fEuQEGdqLRGROlxWC2bs54GweePcLM5rKNkVPkHdDGJ95LL1tECnHw=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:05.245806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-9ed3ae97-fd4c-4fbf-a1f1-83bbf0b67249 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for project 2f7e8103418741398872d59d16e0e919. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:05.249700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-9ed3ae97-fd4c-4fbf-a1f1-83bbf0b67249 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for user d10c68b7fd4446feb759832913fea3b3 and project 2f7e8103418741398872d59d16e0e919. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:05.311072 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:05.319228 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4e7be0da-76a8-47f5-82f2-fccd7b497088 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.160769 Jul 21 22:58:05.319798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 318/684] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:05 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:05.321860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ed3ae97-fd4c-4fbf-a1f1-83bbf0b67249 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.096658 Jul 21 22:58:05.322452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 367/685] 10.222.0.52 () {62 vars in 1199 bytes} [Thu Jul 21 22:58:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 21 22:58:06.336670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:06.337367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:06.343942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.344394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.345159 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.345600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.530069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:06.539793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-13a4602a-3c1c-48ab-a253-43110f6fd410 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.206972 Jul 21 22:58:06.540369 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 319/686] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:06 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:07.557975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:07.558615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:07.562299 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:07.566392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.566889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:07.567646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.568087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:07.587043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-355977136", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9aabd78e-e211-4aea-bb01-9d58894470ca"}], "security_groups": [{"name": "tempest-securitygroup--796497513"}], "key_name": "tempest-keypair-576003966", "user_data": "}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:07.691388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] validate_networks() for [('9aabd78e-e211-4aea-bb01-9d58894470ca', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:58:07.704539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:07.713156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c42b8fc6-cbde-49a7-bf4a-22e3f34f9f2b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.159632 Jul 21 22:58:07.713724 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 368/687] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:07 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:08.298217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:58:08.298898 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:58:08.299511 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:58:08.299921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:58:08.300327 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:58:08.309257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.309709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.310502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.310967 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.327432 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for project 2f7e8103418741398872d59d16e0e919. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:08.331566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Getting quotas for user d10c68b7fd4446feb759832913fea3b3 and project 2f7e8103418741398872d59d16e0e919. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:08.343570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:58:08.346317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:58:08.480023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7b434581-3112-42f0-97d0-16deb697a652 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.897131 Jul 21 22:58:08.485323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 320/688] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Jul 21 22:58:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 21 22:58:08.490641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:08.491308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:08.544904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.552048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.553584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.554684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9fa1abad-fa77-4ca8-b536-201a61431f79 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1280 microversion: 2.20 time: 0.067915 Jul 21 22:58:08.555271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 369/689] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:08 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:08.731137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:08.731799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:08.738932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.739377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.740137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.740567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.873874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.882717 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-81cf8378-8c31-467f-a66f-6a31206e79d4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.156008 Jul 21 22:58:08.883309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 321/690] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:08 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:09.572732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:09.573275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:09.580048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.580497 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.581268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.581734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.641476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:09.649262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:09.650751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:09.651843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3c27183d-ba3c-44fd-b393-137ab18f51b7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1284 microversion: 2.20 time: 0.083188 Jul 21 22:58:09.652395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 370/691] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:09 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:09.900033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:09.900651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:09.907413 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.907867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.909265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.909704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.038239 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.046252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0fa269e2-b79a-41ae-bfeb-82da6a28b230 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.150111 Jul 21 22:58:10.047153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 322/692] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:09 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:10.669498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:10.670107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:10.677124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:10.677556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.678350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:10.678805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.743210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.751204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.753367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.754478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dc455185-930a-4c38-93f4-a938399a8e88 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1284 microversion: 2.20 time: 0.088962 Jul 21 22:58:10.755070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 371/693] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:10 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:11.063021 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:11.063654 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:11.065882 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:11.070605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.071084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.071853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.072333 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.199420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:11.207444 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1d60dd26-83b1-460b-8924-45de1859a372 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.148237 Jul 21 22:58:11.212247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 323/694] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:11 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:11.771992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:11.772642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:11.779283 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.779731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.780496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.780930 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.995873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.004389 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.005919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.007075 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-62cc49da-bc72-4a6f-a9d4-79c7e23d8e5f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1332 microversion: 2.20 time: 0.239573 Jul 21 22:58:12.007662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 372/695] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:11 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:12.224479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:12.225076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:12.231920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.232372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.233143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.233579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.432590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.441545 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6bb4fdb0-ff03-4f0f-b722-7c2e5b9c4195 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.221306 Jul 21 22:58:12.451134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 324/696] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:12 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:12.592748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:12.593366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:12.600056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.600504 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.601251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.601676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.731432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.740191 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e156a1bf-eb0d-4352-b735-6ac8c2620f5c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1596 microversion: 2.1 time: 0.151430 Jul 21 22:58:12.741012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 373/697] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:12 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1596 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:13.024590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.025205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.031217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.031668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.032486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.032927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.101110 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.109349 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.114758 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.114758 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f06417ce-6a51-410e-a12a-0b02848aa2de tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1340 microversion: 2.20 time: 0.091977 Jul 21 22:58:13.114758 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 325/698] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:13.152434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.153687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.160392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.160838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.161607 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.162041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.188219 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f33adc81-00d9-4593-bc30-09387a8fb1ce tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/ips" status: 200 len: 149 microversion: 2.1 time: 0.039918 Jul 21 22:58:13.188813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 374/699] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:13.199852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a23f592-54fd-4ee5-9b0e-4ac3a90aac20"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:13.201058 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.207077 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.212298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.212298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.212298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.289815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: POST /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/os-volume_attachments HTTP/1.1 Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 74 Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:58:13.291687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {"volumeAttachment": {"volumeId": "0a23f592-54fd-4ee5-9b0e-4ac3a90aac20"}} Jul 21 22:58:13.293071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'server_id': 'a0a2b99f-a099-4b41-8f45-90670baf9a15', 'body': {'volumeAttachment': {'volumeId': '0a23f592-54fd-4ee5-9b0e-4ac3a90aac20'}}} Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:13.294039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:13.295891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 400 to user: Invalid volume: volume 0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 is already attached to instances: 493bb0f1-8dde-4694-8e46-35e451a66b7a {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-edef23ed-05c6-4fa3-9951-5bb6bff612c8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097213 Jul 21 22:58:13.297666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 326/700] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:58:13 2022] POST /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:58:13.302250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.302734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.309392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.309833 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.310582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.311033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.341675 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:58:13.459352 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.460079 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.467777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.468601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.469562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.470005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.609050 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.617657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-abe2494b-21a9-4255-ba6c-d293fd10d3c8 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.162562 Jul 21 22:58:13.618225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 327/701] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:13.629536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-67ceb64d-7cc5-4131-87ca-bd54287df74b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 204 len: 0 microversion: 2.1 time: 0.331305 Jul 21 22:58:13.630127 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 375/702] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:58:13 2022] DELETE /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:58:13.638422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.639158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.645905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.646455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.647365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.647880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.859257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.867501 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a60feef7-fd13-4740-9840-e49842a60e69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1681 microversion: 2.1 time: 0.233125 Jul 21 22:58:13.868272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 328/703] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:14.132055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:14.132899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:14.139746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.140211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.141071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.141830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.498758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:14.507835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:14.510674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:14.510846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a62e6db-0130-49c8-b995-f0333bea2e6b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1350 microversion: 2.20 time: 0.383733 Jul 21 22:58:14.511570 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 376/704] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:14 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1350 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:14.635724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:14.636363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:14.643005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.643462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.644242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.644676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.780287 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:14.786581 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3d1f8fa9-6114-4703-8af3-b187d82fe4e4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.154693 Jul 21 22:58:14.787178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 329/705] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:14 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:14.886526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:14.887160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:14.893484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.893931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.894696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.895216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.013109 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-836a5b7e-8911-40ff-b699-fd273560d599 req-51d15b0c-c3a0-4197-a495-a9191772b722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:15.033317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-836a5b7e-8911-40ff-b699-fd273560d599 req-51d15b0c-c3a0-4197-a495-a9191772b722 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.036425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-836a5b7e-8911-40ff-b699-fd273560d599 req-51d15b0c-c3a0-4197-a495-a9191772b722 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.053851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-836a5b7e-8911-40ff-b699-fd273560d599 req-51d15b0c-c3a0-4197-a495-a9191772b722 service nova] Creating event network-changed:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 22:58:15.059856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.060012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-836a5b7e-8911-40ff-b699-fd273560d599 req-51d15b0c-c3a0-4197-a495-a9191772b722 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050066 Jul 21 22:58:15.060700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 330/706] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:15.068970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4b5d82cf-7994-42b2-9c87-8ce7e2e7de41 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1681 microversion: 2.1 time: 0.187358 Jul 21 22:58:15.069657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 377/707] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:14 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:15.536837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:15.539534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:15.547798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.548248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.550000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.550766 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.641527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.651425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.653754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.655003 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bf2f11fe-8cd0-4aea-a1b4-375107055aef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1338 microversion: 2.20 time: 0.129109 Jul 21 22:58:15.658890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 331/708] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:15 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1338 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:15.806345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:15.807670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:15.815428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.816329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.817224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.817664 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.009280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:16.021707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6495a028-8580-48ba-b764-c266337c5939 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1736 microversion: 2.1 time: 0.222452 Jul 21 22:58:16.026915 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 378/709] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:15 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:16.086593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:16.087262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:16.093346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.093799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.094609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.095076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.315051 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:16.323913 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-33d0e13e-6716-4be7-a18c-ce8c0422de53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1681 microversion: 2.1 time: 0.241099 Jul 21 22:58:16.331899 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 332/710] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:16 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:16.673703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:16.675252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:16.682582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.683437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.684434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.685157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.039661 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:17.040373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.043733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.048204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.048657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.050467 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.051108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.059007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.059007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.059007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a49c498-a5ca-4bd9-b57d-884b5a4733f8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.388681 Jul 21 22:58:17.073822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 379/711] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:16 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:17.275919 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.289355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c0ea595f-4f48-4946-91aa-5843e754d861 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1716 microversion: 2.1 time: 0.253578 Jul 21 22:58:17.290753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 333/712] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:17 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1716 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:17.342549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:17.343188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.355807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.357897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.358908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.359519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.365033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:17.423121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:17.423728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.432261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.432801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.433653 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.434190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.518729 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.527100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-17384173-41a4-405a-a786-5a2a643c8f86 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1613 microversion: 2.1 time: 0.189442 Jul 21 22:58:17.528365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 380/713] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:17 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1613 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:17.543445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] HTTP exception thrown: Cannot 'detach_volume' instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 while it is in vm_state rescued Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Request method failure captured: Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments/cce434a0-afcc-430f-b445-ddbe5b9e9dc7 HTTP/1.1 Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djl5ylwvFwuVrwvAAx1miTGYbgUP0wxjDzIWQN_wotuovo_JjFSah6fPcyhqCTGKTnRinb0zYPJccMuNINNRm8OspiSPFukoU_9DFcd3MoPFKL0e2ofx90ja16Qblzqmg7Kg6XXKSVHpT0GN_dnqS5DzkOZulWWKQ0zzbfBHmieH9g Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:58:17.545173 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_755a70c4912f4795ae67cf9f036e02aa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4947466838974a71815561640fa55c14 Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:58:17.546449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Cannot 'detach_volume' instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 while it is in vm_state rescued Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'server_id': '1eaf8f01-0480-4896-bcb0-e1815f7ace90', 'id': 'cce434a0-afcc-430f-b445-ddbe5b9e9dc7'} Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:17.547190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 while it is in vm_state rescued Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 while it is in vm_state rescued Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:58:17.548341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Returning 409 to user: Cannot 'detach_volume' instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 while it is in vm_state rescued {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:17.550466 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-286e2e7f-6bf9-4eb6-8129-bf6e4d93e670 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments/cce434a0-afcc-430f-b445-ddbe5b9e9dc7" status: 409 len: 152 microversion: 2.1 time: 0.128057 Jul 21 22:58:17.555901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:17.556182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 334/714] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:58:17 2022] DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments/cce434a0-afcc-430f-b445-ddbe5b9e9dc7 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 21 22:58:17.556718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.562985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.563386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.564248 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.565427 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.616322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-bbfb8d90-a31f-49c6-82eb-631aa7b1443a req-f5ee0302-6375-4bca-9d98-4bd38a7e839d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:17.634082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-bbfb8d90-a31f-49c6-82eb-631aa7b1443a req-f5ee0302-6375-4bca-9d98-4bd38a7e839d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.634655 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-bbfb8d90-a31f-49c6-82eb-631aa7b1443a req-f5ee0302-6375-4bca-9d98-4bd38a7e839d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.654311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-bbfb8d90-a31f-49c6-82eb-631aa7b1443a req-f5ee0302-6375-4bca-9d98-4bd38a7e839d service nova] Creating event network-changed:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 22:58:17.665270 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-bbfb8d90-a31f-49c6-82eb-631aa7b1443a req-f5ee0302-6375-4bca-9d98-4bd38a7e839d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058572 Jul 21 22:58:17.665270 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 335/715] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:17.921657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-09847cf9-f36e-4068-9542-63f3742b3d50 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/action" status: 202 len: 0 microversion: 2.1 time: 0.362582 Jul 21 22:58:17.921657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 381/716] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:58:17 2022] POST /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:58:17.927517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-edd0e385-b079-4827-89fe-bc7979121a4e req-5a80324d-7ab0-4392-ace8-2312836e21d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a2b99f-a099-4b41-8f45-90670baf9a15", "name": "network-vif-deleted", "tag": "33a5af80-6fed-4810-81a0-1d24345dfa04"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:17.940359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:17.941079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.949602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-edd0e385-b079-4827-89fe-bc7979121a4e req-5a80324d-7ab0-4392-ace8-2312836e21d7 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.951991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-edd0e385-b079-4827-89fe-bc7979121a4e req-5a80324d-7ab0-4392-ace8-2312836e21d7 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.957203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.962122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.963025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.963471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.978896 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:17.984277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-edd0e385-b079-4827-89fe-bc7979121a4e req-5a80324d-7ab0-4392-ace8-2312836e21d7 service nova] Creating event network-vif-deleted:33a5af80-6fed-4810-81a0-1d24345dfa04 for instance a0a2b99f-a099-4b41-8f45-90670baf9a15 on hv-cinder-85069 Jul 21 22:58:17.998043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-edd0e385-b079-4827-89fe-bc7979121a4e req-5a80324d-7ab0-4392-ace8-2312836e21d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073200 Jul 21 22:58:18.000843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 336/717] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:18.083236 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:18.085038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:18.099627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.101388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.102262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.102714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.325158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:18.340194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=6 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:18.345867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.365612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7fda79bb-78a7-41e3-94c9-d6597a3b91a4 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1724 microversion: 2.1 time: 0.434805 Jul 21 22:58:18.366227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 382/718] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:17 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:18.394295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-789023141"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:18.395882 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:18.419299 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.420075 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.425373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.426811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.449961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.478349 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.483496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.484977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2f7be39c-4f00-4f05-a4f6-62d26448a2d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.412181 Jul 21 22:58:18.497567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 337/719] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:18 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:18.635132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:18.635132 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:18.636197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:18.636664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.636664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.636664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.636664 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.637265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.637265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.637265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'fault' on Instance uuid a0a2b99f-a099-4b41-8f45-90670baf9a15 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:18.683801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.network.security_group_api [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Adding security group 0eb4bfcd-0b5d-4967-b47c-d2701c1b76a0 to port f2c971ef-1e12-4937-8388-d94ceee5e560 Jul 21 22:58:18.697734 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.708998 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5a0874a7-0dda-458b-95c3-de0886270ac4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 200 len: 1331 microversion: 2.1 time: 0.166562 Jul 21 22:58:18.709576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 338/720] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:18 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:19.260319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bba7d924-483a-461d-803e-4b0efb4b2a7c tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action" status: 202 len: 0 microversion: 2.1 time: 0.872876 Jul 21 22:58:19.261312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 383/721] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:58:18 2022] POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:19.302025 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.302025 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.303736 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.304417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.305273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.305719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.387033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.387033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.415400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.415996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.416844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.417342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.868889 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:19.874743 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:19.882950 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-aac9a170-87f5-445f-8d72-fa0e29c1c4a8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1761 microversion: 2.1 time: 0.617449 Jul 21 22:58:19.886970 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 339/722] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1761 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:19.887096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2132d51e-56a9-47a6-a18b-173918bfad09 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1724 microversion: 2.1 time: 0.505204 Jul 21 22:58:19.887096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 384/723] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:19.889659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.890454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.891711 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.892383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.899629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.900006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.901266 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.901366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.901629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.901808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.903435 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.904088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.916953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 HTTP/1.1 Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:58:19.918630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 22:58:19.920244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'a0a2b99f-a099-4b41-8f45-90670baf9a15'} Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:19.921107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 22:58:19.922580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:19.924425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:19.925281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6685f73c-4596-4c46-aa25-fe5ca79d501f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 404 len: 111 microversion: 2.1 time: 0.037321 Jul 21 22:58:19.926156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 385/724] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:58:19.934556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-199e1e18-0ee8-4dda-a928-455b65b4c2c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '.version_select at 0x7fc5d7380310>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:20.023451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-199e1e18-0ee8-4dda-a928-455b65b4c2c0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455663696" status: 202 len: 0 microversion: 2.1 time: 0.092762 Jul 21 22:58:20.028989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 386/725] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 21 22:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455663696 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:20.029687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-70ea7745-e0e5-464b-bf73-17c7cf7c2a60 req-71dd940d-c91b-4ce0-93c8-95b468d7c368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:20.043426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-70ea7745-e0e5-464b-bf73-17c7cf7c2a60 req-71dd940d-c91b-4ce0-93c8-95b468d7c368 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.044719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-70ea7745-e0e5-464b-bf73-17c7cf7c2a60 req-71dd940d-c91b-4ce0-93c8-95b468d7c368 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.069623 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-70ea7745-e0e5-464b-bf73-17c7cf7c2a60 req-71dd940d-c91b-4ce0-93c8-95b468d7c368 service nova] Creating event network-changed:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 22:58:20.076776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-70ea7745-e0e5-464b-bf73-17c7cf7c2a60 req-71dd940d-c91b-4ce0-93c8-95b468d7c368 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051030 Jul 21 22:58:20.077166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:20.078115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 387/726] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:20.090001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:20.095251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:20.095251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1bb3030b-d744-4632-ba9c-0151ebc23277 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.207438 Jul 21 22:58:20.095251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 340/727] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:20.871867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:20.872450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:20.879223 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.879676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.880453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.880893 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.907302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:20.908028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:20.915397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.915848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.916618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.917065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.980110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'services' on Instance uuid 493bb0f1-8dde-4694-8e46-35e451a66b7a {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:21.198129 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0b13882e-5647-4e1a-8cde-d03abe8893e9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments/0a23f592-54fd-4ee5-9b0e-4ac3a90aac20" status: 202 len: 0 microversion: 2.1 time: 0.331413 Jul 21 22:58:21.199271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 388/728] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:58:20 2022] DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments/0a23f592-54fd-4ee5-9b0e-4ac3a90aac20 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:21.205336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:21.206550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:21.216073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.216281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.217661 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.218694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.235119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.245674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e41cc639-cffc-4f3d-943e-f4945bb425bd tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1724 microversion: 2.1 time: 0.342242 Jul 21 22:58:21.246820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 341/729] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:20 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:21.259794 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:21.260912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:21.267208 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.271226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.271226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.271226 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.298452 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e81d289d-d22b-4bcc-ade3-440c72be7743 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jul 21 22:58:21.300181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 342/730] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:21 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:21.373235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.382080 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.383618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.384721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-eadbcef9-a108-46c3-b30a-c48dc02b6e0e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.183902 Jul 21 22:58:21.385281 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 389/731] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:21 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:22.001041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.002000 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.008464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.008927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.009689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.010101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.040151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-33e40361-939b-4754-b2b8-8f12536c79ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042948 Jul 21 22:58:22.040688 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 343/732] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:21 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:58:22.099202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.099698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.106431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.107051 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.107828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.108275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.134518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:58:22.264622 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.265285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.271791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.272295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.273052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.273487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.408446 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.416638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-44ee5cd3-3355-4ea4-9ba8-513e3dfa0311 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1730 microversion: 2.1 time: 0.155942 Jul 21 22:58:22.417216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 344/733] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:22.421853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.422780 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.428671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.429124 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.429882 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.430317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.460857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-99b152e0-05b8-48b7-b44c-fe60d628ed34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Jul 21 22:58:22.461403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 345/734] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:22.465916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.466556 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.472103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.472550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.473305 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.473994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.481970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1642e093-8469-4683-874d-73201be7adf3 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 204 len: 0 microversion: 2.1 time: 0.387356 Jul 21 22:58:22.482562 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 390/735] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:58:22 2022] DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:58:22.487910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.490863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.495053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.495613 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.496282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.496709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.577323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d09877c0-ed6d-4fb3-baac-153b81a56de6 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093423 Jul 21 22:58:22.578032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 391/736] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:22.583363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.584106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.590703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.591272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.592154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.592656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.619210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.628672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.630229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.631475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4e83115a-fbd2-407d-8d80-e56bef23ddef tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.169058 Jul 21 22:58:22.632007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 346/737] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:22.804997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.812477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-59a2cda0-fd77-433d-ba32-b755ca85c15a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1675 microversion: 2.1 time: 0.233403 Jul 21 22:58:22.813053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 392/738] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:23.473441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:23.475269 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:23.482218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.482723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.483919 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.484538 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.530706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7a09b2d7-ddf6-48a7-a2df-0256b888254d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061967 Jul 21 22:58:23.531462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 347/739] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:23 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:23.650420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:23.652540 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:23.660054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.660746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.662659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.663193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.704436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-ad4127d3-599e-4248-9f5d-5420458ab140 req-fda95860-3b7a-43ee-9bca-2256df207be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:23.714509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-ad4127d3-599e-4248-9f5d-5420458ab140 req-fda95860-3b7a-43ee-9bca-2256df207be0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.715001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-ad4127d3-599e-4248-9f5d-5420458ab140 req-fda95860-3b7a-43ee-9bca-2256df207be0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.730508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-ad4127d3-599e-4248-9f5d-5420458ab140 req-fda95860-3b7a-43ee-9bca-2256df207be0 service nova] Creating event network-changed:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:58:23.736271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-ad4127d3-599e-4248-9f5d-5420458ab140 req-fda95860-3b7a-43ee-9bca-2256df207be0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036130 Jul 21 22:58:23.737133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 348/740] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:23.821392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:23.831283 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:23.831958 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:23.832229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:23.833478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:23.834801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8f5b261c-66f6-4727-a67d-528952cd7072 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.188200 Jul 21 22:58:23.836258 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 393/741] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:23 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:23.840995 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.849784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.849784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.849784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.004993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:24.014053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0cd1eb7e-2db0-4e76-ad65-0bf592e85bd5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1675 microversion: 2.1 time: 0.188354 Jul 21 22:58:24.014887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 349/742] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:23 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:24.544085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:24.545300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:24.552249 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:24.552659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.553432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:24.553865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.584379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fd4a3548-fe86-474a-94b7-bd3023ff11f7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Jul 21 22:58:24.584968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 394/743] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:24 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:25.032035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:25.033301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:25.041257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.042070 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.043276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.043864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.149007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:25.149609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:25.155651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.156093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.156855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.157282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.184738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.194565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-70db05a0-308e-4b64-8429-0184b9182352 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1675 microversion: 2.1 time: 0.166255 Jul 21 22:58:25.195583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 395/744] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:25 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:25.313940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.322463 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.324108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.325200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0a6497e7-e27e-4f36-8efb-5a656ee44002 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.463727 Jul 21 22:58:25.325765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 350/745] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:24 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:25.603974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:25.609108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:25.620644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.621353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.622536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.623209 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.650815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:25.664737 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2ad0e542-2a89-4a7f-b29d-2bbbaf7567a8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072625 Jul 21 22:58:25.671257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 396/746] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:25 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:25.753604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-908d9051-1389-4689-bd21-7f1d78e7e5a7 req-1175c785-348f-42ac-8189-0c394016340e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:25.762363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-908d9051-1389-4689-bd21-7f1d78e7e5a7 req-1175c785-348f-42ac-8189-0c394016340e service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.763188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-908d9051-1389-4689-bd21-7f1d78e7e5a7 req-1175c785-348f-42ac-8189-0c394016340e service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.779982 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-908d9051-1389-4689-bd21-7f1d78e7e5a7 req-1175c785-348f-42ac-8189-0c394016340e service nova] Creating event network-changed:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:58:25.785060 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-908d9051-1389-4689-bd21-7f1d78e7e5a7 req-1175c785-348f-42ac-8189-0c394016340e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036752 Jul 21 22:58:25.786198 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 351/747] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:26.212235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.212909 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.220469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.221416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.222176 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.222605 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.344730 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.351280 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.354363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.355371 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.355849 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.356344 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.400146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.411716 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3e27987a-2c57-463b-830a-f33c33403199 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1675 microversion: 2.1 time: 0.203287 Jul 21 22:58:26.412576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 397/748] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:26 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:26.677577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.678676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.685005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.693402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.693402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.693402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.697495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.708294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.710191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.711526 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-27fbccde-923a-4a0f-a58f-475f0a70a382 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.371459 Jul 21 22:58:26.712093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 352/749] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:26 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:58:26.724050 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-00f064cc-197f-40fb-9a80-70060cf12831 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050436 Jul 21 22:58:26.725010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 398/750] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:58:26 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:58:26.790106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.790594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.796920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.801804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.801804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.801804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.824885 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:58:26.852642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:27.113126 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-84c5e640-4492-45bf-82ee-6e81a7b05e49 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 204 len: 0 microversion: 2.1 time: 0.325499 Jul 21 22:58:27.114114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 353/751] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:58:26 2022] DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:58:27.123929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:27.124865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:27.133370 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.133827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.134600 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.135101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.290606 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.304888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-867089d6-999a-4f85-84f9-c0fa3b6f04a1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1681 microversion: 2.1 time: 0.186110 Jul 21 22:58:27.313780 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 399/752] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:27 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:27.343611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-9b34eae4-193e-4eae-8f51-31ec08772432 req-8d1e1351-9c3f-4593-af18-59f16b1dfb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "name": "network-vif-plugged", "status": "completed", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:27.359481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9b34eae4-193e-4eae-8f51-31ec08772432 req-8d1e1351-9c3f-4593-af18-59f16b1dfb83 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.360195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9b34eae4-193e-4eae-8f51-31ec08772432 req-8d1e1351-9c3f-4593-af18-59f16b1dfb83 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.373099 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-9b34eae4-193e-4eae-8f51-31ec08772432 req-8d1e1351-9c3f-4593-af18-59f16b1dfb83 service nova] Creating event network-vif-plugged:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 22:58:27.378234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-9b34eae4-193e-4eae-8f51-31ec08772432 req-8d1e1351-9c3f-4593-af18-59f16b1dfb83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 Jul 21 22:58:27.379306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 354/753] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:27.430869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:27.431577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:27.437744 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.438304 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.439333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.439973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.509989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.517897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7aa94b1a-7204-4a32-8be8-ce5514d5bcc4 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1608 microversion: 2.1 time: 0.092262 Jul 21 22:58:27.519001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 400/754] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:27 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:27.618850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-6da3641a-3385-447f-b494-0d67b69377bf req-04930220-1563-40ee-85e3-9356175fa7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3363b2-6211-444c-8595-b3a40ce92109", "name": "network-vif-deleted", "tag": "2d3c9293-bf2d-4f3c-ab9b-47ade12b250a"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:27.627647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6da3641a-3385-447f-b494-0d67b69377bf req-04930220-1563-40ee-85e3-9356175fa7c2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.628175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-6da3641a-3385-447f-b494-0d67b69377bf req-04930220-1563-40ee-85e3-9356175fa7c2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.639320 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-6da3641a-3385-447f-b494-0d67b69377bf req-04930220-1563-40ee-85e3-9356175fa7c2 service nova] Creating event network-vif-deleted:2d3c9293-bf2d-4f3c-ab9b-47ade12b250a for instance 9b3363b2-6211-444c-8595-b3a40ce92109 on hv-cinder-85069 Jul 21 22:58:27.644915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-6da3641a-3385-447f-b494-0d67b69377bf req-04930220-1563-40ee-85e3-9356175fa7c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030207 Jul 21 22:58:27.645507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 355/755] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:27.730571 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:27.731192 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:27.737651 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.738125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.738914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.739340 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.888386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.897245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.898860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.899973 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bff9c18a-0cf3-40f3-a3dd-59404db57f1e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.173269 Jul 21 22:58:27.900538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 401/756] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:27 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:28.322987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:28.323690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:28.330638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.331115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.331900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.332343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.468642 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:28.477253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-37e1136b-26de-49cf-960b-e4e00783ee0a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1681 microversion: 2.1 time: 0.159043 Jul 21 22:58:28.482958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 356/757] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:28 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:28.751004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:28.751644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:28.758350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.758821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.759588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.760027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.828792 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:28.836456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bebccb0a-661f-44ce-9920-8388edf196fd tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1323 microversion: 2.1 time: 0.304699 Jul 21 22:58:28.837027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 402/758] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:28 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:28.917390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:28.917991 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:28.924593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.925038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.925794 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.926230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.053152 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.061127 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.062668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.063879 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0f179826-2d1f-4277-a416-1faa3387f630 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.150272 Jul 21 22:58:29.066820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 357/759] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:28 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:29.495014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:29.495611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:29.502001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.502463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.503287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.503712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.635027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.642449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f95c7a69-3396-49ed-8436-99fc3e15cd43 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1681 microversion: 2.1 time: 0.151360 Jul 21 22:58:29.643537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 403/760] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:29 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:29.853740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:29.854264 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:29.860914 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.861366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.862169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.862609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.925029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.932376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-138a3f22-4113-4032-8168-8aa7950da406 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1323 microversion: 2.1 time: 0.082606 Jul 21 22:58:29.932944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 358/761] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:29 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1323 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:30.081931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:30.082532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:30.088593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.089038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.089822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.090254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.217423 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:30.225615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:30.227140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:30.228243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-57fa46a5-f1f4-4d2d-ab3e-d0a07fa62388 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.150813 Jul 21 22:58:30.228801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 404/762] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:30 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:30.659927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:30.660531 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:30.666514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.666989 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.667747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.668178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.795296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:30.802718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6c82ec87-4c31-40fb-9072-c65020993779 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1681 microversion: 2.1 time: 0.146596 Jul 21 22:58:30.803311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 359/763] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:30 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:30.949455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:30.950062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:30.956612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.957044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.957802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.958239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.021682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.029092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5ce18cae-cb03-46da-b9d4-828c31be51c7 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1323 microversion: 2.1 time: 0.083465 Jul 21 22:58:31.029660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 405/764] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:30 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1323 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:31.245699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:31.246302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:31.253402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.253852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.254617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.255087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.386060 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.394745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.396662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.397870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-128472d7-b97d-4fb5-88cc-de3590727bdc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.156170 Jul 21 22:58:31.400523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 360/765] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:31 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:31.821023 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:31.821533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:31.827558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.828033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.828805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.829240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.036873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.044924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fb7ba232-6b33-4fb9-a97b-553e64e204d5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1681 microversion: 2.1 time: 0.228080 Jul 21 22:58:32.045314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:32.045737 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 406/766] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:31 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:32.045946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:32.053245 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.053716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.054487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.054957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.086257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.086714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.089987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lazy-loading 'fault' on Instance uuid 9b3363b2-6211-444c-8595-b3a40ce92109 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:32.129296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.136671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fb2d63c6-261d-4c2c-95f2-3455dccca1e6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 200 len: 1328 microversion: 2.1 time: 0.095171 Jul 21 22:58:32.137242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 361/767] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:32 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:32.417004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:32.417751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:32.425599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.427460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.427460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.427692 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.535194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-fbe29f26-1aa5-4d4c-a6c1-d346edee27eb req-6a8abe74-7c6b-4fcd-9e7c-7c4c68e024da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493bb0f1-8dde-4694-8e46-35e451a66b7a", "name": "network-vif-deleted", "tag": "11031c16-fb45-409c-9526-c98d27b69652"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:32.544341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-fbe29f26-1aa5-4d4c-a6c1-d346edee27eb req-6a8abe74-7c6b-4fcd-9e7c-7c4c68e024da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.544781 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-fbe29f26-1aa5-4d4c-a6c1-d346edee27eb req-6a8abe74-7c6b-4fcd-9e7c-7c4c68e024da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.557406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-fbe29f26-1aa5-4d4c-a6c1-d346edee27eb req-6a8abe74-7c6b-4fcd-9e7c-7c4c68e024da service nova] Creating event network-vif-deleted:11031c16-fb45-409c-9526-c98d27b69652 for instance 493bb0f1-8dde-4694-8e46-35e451a66b7a on hv-cinder-85069 Jul 21 22:58:32.562384 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-fbe29f26-1aa5-4d4c-a6c1-d346edee27eb req-6a8abe74-7c6b-4fcd-9e7c-7c4c68e024da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030795 Jul 21 22:58:32.563323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 362/768] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:32.606405 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.615901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.618702 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.619035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-15cc7b73-70ef-4c7f-bba6-97e7ef6fa12a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.206759 Jul 21 22:58:32.623621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 407/769] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:32 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:33.064299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.065626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.072005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.072530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.073309 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.073742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.139228 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.147494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2a399ae7-c725-49aa-aa46-50733d96afe8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1325 microversion: 2.1 time: 0.087318 Jul 21 22:58:33.161590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.162204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.165600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 363/770] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:33.169017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.169556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.170328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.170766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.185773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 HTTP/1.1 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:58:33.187392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 22:58:33.189016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '9b3363b2-6211-444c-8595-b3a40ce92109'} Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:33.190372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 22:58:33.191585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:33.193435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:33.193435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1273cd38-b5d5-436f-a0d3-d8a98247f315 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 404 len: 111 microversion: 2.1 time: 0.031095 Jul 21 22:58:33.193435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 408/771] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:58:33.203799 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2af0623d-4d34-41e3-a4ca-85992549fa6e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '.version_select at 0x7fc5e422b3a0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.290648 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2af0623d-4d34-41e3-a4ca-85992549fa6e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004366987" status: 202 len: 0 microversion: 2.1 time: 0.090717 Jul 21 22:58:33.291348 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 364/772] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 21 22:58:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004366987 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:33.637743 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.638491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.644761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.645287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.646109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.646612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.853491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.861314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.862828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.863918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6261cbf9-d14b-4085-8e00-b1b661f9f268 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.230205 Jul 21 22:58:33.864466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 409/773] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:34.089650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54003e09-ec25-4d63-8927-dd59449adb29 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: .version_select at 0x7fc5e4268f70>, body: {"keypair": {"name": "tempest-keypair-1866407849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMA3laE1Iu4DI7PCuDh9hvF+NKr8s6ErEbt+gYeYnimT1rNXnt/JTy34e6m4Am6AN4q+Qbo2eyQmnbHfx6RdZl3Q0lD4WRWwrqr+t1QoJC1NvlrIHiUY6ucTEyDSCQwJ2A=="}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:34.104424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-54003e09-ec25-4d63-8927-dd59449adb29 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for project 08576395a1f1437385d2f24b482572a6. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:34.106598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:34.108848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-54003e09-ec25-4d63-8927-dd59449adb29 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for user ef9ff560b7044ea2a18b3c3f8295937e and project 08576395a1f1437385d2f24b482572a6. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:34.164477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:34.165115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:34.167464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:34.172173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.172617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.173367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.175491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.205597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.206073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.206495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'fault' on Instance uuid 493bb0f1-8dde-4694-8e46-35e451a66b7a {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:34.225356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-54003e09-ec25-4d63-8927-dd59449adb29 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140437 Jul 21 22:58:34.225962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 365/774] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:58:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:34.264954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:34.272468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5114b15f-aa89-44d3-99e6-d1ab267e351e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1330 microversion: 2.1 time: 0.112037 Jul 21 22:58:34.273046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 410/775] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:34 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:34.882504 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:34.883158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:34.889591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.890042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.890827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.891262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.025814 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.034259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.035789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.036886 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-293705fe-b141-42c6-b96c-c20d4ee85402 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.158678 Jul 21 22:58:35.037446 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 366/776] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:34 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:35.289978 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:35.290600 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:35.297626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:35.298069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.298854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:35.299905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.331597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:35.331889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.332345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'fault' on Instance uuid 493bb0f1-8dde-4694-8e46-35e451a66b7a {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:35.657631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.665725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-af79b55d-cace-4e83-bfed-e1721b10c048 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1330 microversion: 2.1 time: 0.379599 Jul 21 22:58:35.666296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 411/777] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:35 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1330 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:36.054297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:36.055035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:36.061588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.062043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.062828 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.063270 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.204235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.213056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.214682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.215915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f2a6c382-897d-4fb9-838b-4099cda549b4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1405 microversion: 2.20 time: 0.165513 Jul 21 22:58:36.216556 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 367/778] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:36 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:36.577903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1303442120", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "886605d9-b2c5-42f8-a453-66f8a90cc2d9"}], "security_groups": [{"name": "tempest-securitygroup--215709030"}], "key_name": "tempest-keypair-1866407849", "user_data": "}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:36.682712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:36.683326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:36.683842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] validate_networks() for [('886605d9-b2c5-42f8-a453-66f8a90cc2d9', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:58:36.689335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.689864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.690662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.691118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.887414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.887935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.888994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'fault' on Instance uuid 493bb0f1-8dde-4694-8e46-35e451a66b7a {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:36.937520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.945752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f66ba74d-3a4e-44a1-871f-f2cf47fec913 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 200 len: 1330 microversion: 2.1 time: 0.266904 Jul 21 22:58:36.954979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 368/779] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:36 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 1330 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:37.089351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:58:37.089776 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:58:37.090238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:58:37.090638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:58:37.091074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:58:37.101819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.102365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.103350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.103780 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.122210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for project 08576395a1f1437385d2f24b482572a6. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:37.126585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Getting quotas for user ef9ff560b7044ea2a18b3c3f8295937e and project 08576395a1f1437385d2f24b482572a6. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:37.138929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:58:37.141367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:58:37.233808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.234315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.241250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.241822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.242579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.243121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.362210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a704f37b-6657-4768-8192-8cea0c829250 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.787742 Jul 21 22:58:37.363272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 412/780] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:58:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:58:37.373465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f21131c2-a1ec-43a4-8f2a-cfa9489c1681 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.374073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f21131c2-a1ec-43a4-8f2a-cfa9489c1681 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.386516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:37.395177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:37.396659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:37.397790 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-00eb7c7d-f37a-4915-bbdf-182c5837a0bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1597 microversion: 2.20 time: 0.168212 Jul 21 22:58:37.398334 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 369/781] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:58:37.415689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.416178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.423109 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.423563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.424909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.425350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.443754 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f21131c2-a1ec-43a4-8f2a-cfa9489c1681 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:37.450761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f21131c2-a1ec-43a4-8f2a-cfa9489c1681 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1238 microversion: 2.1 time: 0.081558 Jul 21 22:58:37.454831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 413/782] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:37.509624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9d6e8fc8-3bf7-459b-b13e-6b22178fb9db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097838 Jul 21 22:58:37.510211 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 370/783] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:58:37.962712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.963352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.970855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.971306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.972074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.972504 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.987672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a HTTP/1.1 Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:58:37.988524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 22:58:37.989965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '493bb0f1-8dde-4694-8e46-35e451a66b7a'} Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:37.990671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 22:58:37.992348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.994705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:37.994705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c35e42bd-5d73-4dbf-b700-e6e9489166fc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 404 len: 111 microversion: 2.1 time: 0.031324 Jul 21 22:58:37.999256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-efeff18b-b93b-4d2d-9686-75962fc9076b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '.version_select at 0x7fc5e42680d0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.002789 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 414/784] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:58:38.084891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-efeff18b-b93b-4d2d-9686-75962fc9076b tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670950779" status: 202 len: 0 microversion: 2.1 time: 0.089611 Jul 21 22:58:38.085706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 371/785] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 21 22:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670950779 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:38.467452 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.468122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:38.484556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.486168 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.487734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.488880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.514467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:38.576733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:38.584876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-1dc0d134-334c-4e4a-89e5-1e2314ec93f0 req-ac46524d-1657-4c5f-a6dc-a2f52310fcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:38.595406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6df07913-c690-433e-b688-468ea3476f42 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1242 microversion: 2.1 time: 0.132262 Jul 21 22:58:38.596541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 415/786] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:38 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:38.609422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1dc0d134-334c-4e4a-89e5-1e2314ec93f0 req-ac46524d-1657-4c5f-a6dc-a2f52310fcc4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.609877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1dc0d134-334c-4e4a-89e5-1e2314ec93f0 req-ac46524d-1657-4c5f-a6dc-a2f52310fcc4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.621937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-1dc0d134-334c-4e4a-89e5-1e2314ec93f0 req-ac46524d-1657-4c5f-a6dc-a2f52310fcc4 service nova] Creating event network-changed:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 22:58:38.627008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-1dc0d134-334c-4e4a-89e5-1e2314ec93f0 req-ac46524d-1657-4c5f-a6dc-a2f52310fcc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046757 Jul 21 22:58:38.628699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 372/787] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:38.653038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:38.653604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:38.660648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.661112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.662313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.663055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.697727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lazy-loading 'flavor' on Instance uuid 714e3636-339b-4d42-89b1-e3a5a6736c71 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:58:38.962672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a21edd88-bf94-4ade-8d61-e7bf185ba1a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: .version_select at 0x7fc5e41acb80>, body: {"keypair": {"name": "tempest-keypair-1559530401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0ccJdZNpi15zeDBlo3MRQRrr+BIZ2JVjby2ii9WIA7hvzgGT2jhsWvKqprmiH/hLiljryQz4GptvBCwFFMG/nFZT5ZAQzQBjV7eKajbMJULtN8q4Qgaf12Zow9RfKBEA=="}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:38.977497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-a21edd88-bf94-4ade-8d61-e7bf185ba1a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:38.981581 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-a21edd88-bf94-4ade-8d61-e7bf185ba1a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:38.988615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-81864bc7-80a2-487a-88e4-adaf2c11cfa0 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "POST /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71/action" status: 202 len: 0 microversion: 2.1 time: 0.335201 Jul 21 22:58:38.988615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 416/788] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:58:38 2022] POST /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:38.996045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.996765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:39.005523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.005978 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.006865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.007264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.068905 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a21edd88-bf94-4ade-8d61-e7bf185ba1a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110606 Jul 21 22:58:39.073163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 373/789] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 22:58:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:39.161195 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:39.169384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3663bcf2-869d-4be0-902d-8139cfff266f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.177550 Jul 21 22:58:39.169983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 417/790] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:38 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:39.614061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:39.614669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:39.623946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.624405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.625359 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.625807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.692041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:39.696118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3a7f516b-f39d-4b79-a98a-97f8746a9334 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1242 microversion: 2.1 time: 0.087039 Jul 21 22:58:39.699443 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 374/791] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:39 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:40.187388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:40.187991 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:40.194492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.194981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.195785 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.196220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.329016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:40.337360 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-92b7108f-7be3-4424-af36-bb9e85dbb0c1 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.153768 Jul 21 22:58:40.338137 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 418/792] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:40 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:40.715095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:40.715095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:40.720715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.721237 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.722026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.808168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:40.811869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:40.817161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5943a9fd-a52f-4540-848e-801d536ea181 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1234 microversion: 2.1 time: 0.108299 Jul 21 22:58:40.817742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 375/793] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:40 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1234 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:41.354923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:41.355527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:41.362546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.363025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.363827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.364264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.395850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1089751060", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be9945ce-a7e9-414b-b532-8c7c706d9d8c"}], "security_groups": [{"name": "tempest-securitygroup--91596208"}], "key_name": "tempest-keypair-1559530401", "user_data": "}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:41.527045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:41.536135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7f32e832-9283-4446-bfb4-4406303edd62 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.185035 Jul 21 22:58:41.536592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] validate_networks() for [('be9945ce-a7e9-414b-b532-8c7c706d9d8c', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:58:41.536737 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 419/794] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:41 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:41.835028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:41.836056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:41.844092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.844646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.845585 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.846701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.107367 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:42.116961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-54700a67-0198-4620-8c94-e4f081075646 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1298 microversion: 2.1 time: 0.287014 Jul 21 22:58:42.118759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 420/795] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:41 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:42.151496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:58:42.153022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:58:42.155107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:58:42.160747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:58:42.160747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:58:42.169535 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.169971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.170754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.171257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.188597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:58:42.193311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:58:42.204405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:58:42.206741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:58:42.343085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a5cc45ef-5af6-4fff-bc9f-e5c589588c79 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.953198 Jul 21 22:58:42.343837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 376/796] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:58:41 2022] POST /compute/v2.1/servers => generated 400 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:58:42.355720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ae383d61-a9c0-4c34-a70b-ee4d224c1ccf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:42.356419 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ae383d61-a9c0-4c34-a70b-ee4d224c1ccf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:42.437401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ae383d61-a9c0-4c34-a70b-ee4d224c1ccf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:42.447295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ae383d61-a9c0-4c34-a70b-ee4d224c1ccf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1242 microversion: 2.1 time: 0.095596 Jul 21 22:58:42.448880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 421/797] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:42 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:42.553262 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:42.554096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:42.562377 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.562873 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.563763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.564268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.716917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:42.728961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-59f80d65-af45-435c-a61f-1cf0ad9fb721 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.179260 Jul 21 22:58:42.730056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 377/798] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:42 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:43.139519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:43.140052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:43.146558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.147040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.147806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.148240 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.359790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:43.368359 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c3ad4aca-7ef8-480b-b80e-fd7f72e254f5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.232871 Jul 21 22:58:43.369201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 422/799] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:43 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:43.465481 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:43.466095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:43.472361 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.472908 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.473634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.474070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.547277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:43.560213 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-57383cac-d960-407e-a89c-6f248873aa0e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1246 microversion: 2.1 time: 0.098630 Jul 21 22:58:43.561310 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 378/800] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:43 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:43.660162 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-30f5fe76-6134-4e04-a5ad-886514813299 req-07e36a0c-55b0-4a5c-817c-b85a01492803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7af3cf9-8c87-41f9-a908-b12ca94202dd", "tag": "18c604d0-57b0-45a4-a124-d78abd64bf0c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:43.670758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-30f5fe76-6134-4e04-a5ad-886514813299 req-07e36a0c-55b0-4a5c-817c-b85a01492803 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.671296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-30f5fe76-6134-4e04-a5ad-886514813299 req-07e36a0c-55b0-4a5c-817c-b85a01492803 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.683246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-30f5fe76-6134-4e04-a5ad-886514813299 req-07e36a0c-55b0-4a5c-817c-b85a01492803 service nova] Creating event network-changed:18c604d0-57b0-45a4-a124-d78abd64bf0c for instance f7af3cf9-8c87-41f9-a908-b12ca94202dd on hv-cinder-85069 Jul 21 22:58:43.688221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-30f5fe76-6134-4e04-a5ad-886514813299 req-07e36a0c-55b0-4a5c-817c-b85a01492803 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098051 Jul 21 22:58:43.688900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 423/801] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:43.745706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:43.746317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:43.754149 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.754829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.755971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.756420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.892497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:43.901397 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fd9c58a8-2572-4a10-b833-c9e08b1d4fcb tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.159596 Jul 21 22:58:43.901977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 379/802] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:43 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:44.392263 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:44.393598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:44.399781 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.400234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.400989 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.401421 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.532788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:44.540428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-beb077ef-0337-44ca-9c32-df6436a9e442 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.152798 Jul 21 22:58:44.541081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 424/803] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:44 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:44.577337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:44.578029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:44.584140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.584591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.585350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.585784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.647738 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:44.657495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-67226deb-9a26-4133-b638-cb78c44b0953 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1294 microversion: 2.1 time: 0.083988 Jul 21 22:58:44.659225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 380/804] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:44 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:44.919140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:44.919778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:44.926363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.926825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.927594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.928030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.071556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:45.079301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2b7362f4-80af-4b5f-bb11-76f0d98d740f tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.163880 Jul 21 22:58:45.079869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 425/805] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:44 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:45.558722 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:45.559351 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:45.566638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.567107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.567862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.568293 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.679724 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:45.680331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:45.687002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.687460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.688245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.688690 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.701881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:45.709574 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-17f640d3-0e6e-4321-bf71-2b8fc2b27017 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.154763 Jul 21 22:58:45.710339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 381/806] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:45 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:45.754944 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:45.762365 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-bae97dbe-bd05-484a-a652-d0bd0bfbca73 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1302 microversion: 2.1 time: 0.086528 Jul 21 22:58:45.762972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 426/807] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:45 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:46.097194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:46.097827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:46.104570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.105020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.105782 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.106219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.310390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:46.318668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3de01b05-4020-4879-bac5-bccda5fdd981 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.225448 Jul 21 22:58:46.319347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 382/808] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:46 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:46.727105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:46.727750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:46.734295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.734815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.738625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.738625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.780205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:46.792878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:46.796399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.796862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.797651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.798119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.881557 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:46.890374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8173d7fb-f4dc-4892-8273-baab4c395661 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.167619 Jul 21 22:58:46.891310 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 427/809] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:46 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:47.014663 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:47.023046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2904be5b-4ae4-44ff-aaeb-c870941d29dc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.246602 Jul 21 22:58:47.023562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 383/810] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:46 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:47.336821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:47.341447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:47.341447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:47.344411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.344865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.345641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.346094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.505660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:47.514104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-323ecf1b-f79d-4214-9e20-4468e4704b80 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.181069 Jul 21 22:58:47.514678 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 428/811] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:47 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:47.879651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-2d802f7c-2855-473f-966b-bce8520f772c req-506e25f8-bbef-4d63-b3e3-fa3f352afc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35fff0c7-83f1-445a-b6e0-32d1f5831ecb", "tag": "31ffe9d2-f878-4725-811a-0c9011087597"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:47.893465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-2d802f7c-2855-473f-966b-bce8520f772c req-506e25f8-bbef-4d63-b3e3-fa3f352afc65 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.896960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-2d802f7c-2855-473f-966b-bce8520f772c req-506e25f8-bbef-4d63-b3e3-fa3f352afc65 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.909767 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:47.910361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:47.918496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.918971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.919735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.920165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.931821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-2d802f7c-2855-473f-966b-bce8520f772c req-506e25f8-bbef-4d63-b3e3-fa3f352afc65 service nova] Creating event network-changed:31ffe9d2-f878-4725-811a-0c9011087597 for instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb on hv-cinder-85069 Jul 21 22:58:47.937843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-2d802f7c-2855-473f-966b-bce8520f772c req-506e25f8-bbef-4d63-b3e3-fa3f352afc65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231746 Jul 21 22:58:47.938415 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 384/812] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:48.040272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:48.041556 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:48.050355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.051096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.052057 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.052651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.092657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:48.100903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9d3e968c-c615-428a-8ea6-c50678fa7d7e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.196777 Jul 21 22:58:48.101656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 429/813] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:47 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:48.286717 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:48.294282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-99757314-6cab-40b9-a345-93fc632f599d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.258402 Jul 21 22:58:48.294876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 385/814] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:48 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:48.531723 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:48.532352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:48.539444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.540512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.541629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.542265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.683422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:48.691747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-724fbdfb-332b-40a6-8330-552cf8fbfc94 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.164002 Jul 21 22:58:48.692322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 430/815] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:48 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:49.118401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:49.119693 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.126495 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.127672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.128436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.128868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.254271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:49.255317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.261894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.262346 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.263179 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.263616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.264598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.273141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-03ca23bf-21de-4e82-ad22-5e2037bb6472 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.158384 Jul 21 22:58:49.273724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 386/816] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:49 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:49.296986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:49.311248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:49.311856 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.318535 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.319029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.319947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.320547 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.449604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.457741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-237b8ac8-fba7-4800-b525-127eeb54c526 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.150390 Jul 21 22:58:49.458319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 387/817] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:49 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:49.470898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0aa04a5a-8fdd-431b-b5bb-3908f178cbda tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action" status: 202 len: 0 microversion: 2.1 time: 0.220953 Jul 21 22:58:49.471537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 431/818] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:58:49 2022] POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:58:49.479679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:49.480290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.486306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.486753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.487549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.487980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.625875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.634243 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-10470e9b-59c0-4ba0-a88e-4a9bb8dd501b tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1753 microversion: 2.1 time: 0.158295 Jul 21 22:58:49.634835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 388/819] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:49 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:49.710104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:49.710816 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.717357 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.717815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.718578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.719040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.862670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.870629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-799c9867-db48-457c-b251-0da581387f92 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.165202 Jul 21 22:58:49.871601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 432/820] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:49 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.289555 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.290144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.296563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.297035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.297929 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.298370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.434561 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:50.442597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3f9ccf37-9390-48e8-af91-38eacf6de738 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.156915 Jul 21 22:58:50.443176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 389/821] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.474852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.475413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.481835 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.482272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.483048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.483476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.615033 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:50.622583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4370b0d8-f57c-4879-a22c-6d3e6e5a3382 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.151952 Jul 21 22:58:50.623235 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 433/822] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.652267 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.652876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.659053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.659505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.660284 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.660718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.717208 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-083e8a43-4344-4619-97aa-84a6153d5be1 req-f8ed76fe-7386-4420-9c81-6ae95964e858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7af3cf9-8c87-41f9-a908-b12ca94202dd", "name": "network-vif-plugged", "status": "completed", "tag": "18c604d0-57b0-45a4-a124-d78abd64bf0c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:50.733079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-083e8a43-4344-4619-97aa-84a6153d5be1 req-f8ed76fe-7386-4420-9c81-6ae95964e858 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.733450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-083e8a43-4344-4619-97aa-84a6153d5be1 req-f8ed76fe-7386-4420-9c81-6ae95964e858 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.746874 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-083e8a43-4344-4619-97aa-84a6153d5be1 req-f8ed76fe-7386-4420-9c81-6ae95964e858 service nova] Creating event network-vif-plugged:18c604d0-57b0-45a4-a124-d78abd64bf0c for instance f7af3cf9-8c87-41f9-a908-b12ca94202dd on hv-cinder-85069 Jul 21 22:58:50.751720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-083e8a43-4344-4619-97aa-84a6153d5be1 req-f8ed76fe-7386-4420-9c81-6ae95964e858 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Jul 21 22:58:50.753192 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 434/823] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:50.817082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:50.825676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c5ee998b-4033-49ff-a733-3dcce8743684 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.177206 Jul 21 22:58:50.826259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 390/824] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.889730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.889730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.896729 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.896869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.897593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.898029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.118335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:51.124815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-de3cc2c5-cc27-408d-b759-69e2cfdba764 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.240125 Jul 21 22:58:51.125390 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 435/825] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:51.459623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:51.460241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:51.466697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.467190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.467965 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.468438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.639811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:51.640363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:51.647876 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.648327 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.649111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.649550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.786012 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:51.793627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f177f93c-b312-46f9-a31d-8e3f1fe361d8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.157780 Jul 21 22:58:51.794194 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 436/826] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:51 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:51.840162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:51.843246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:51.843880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:51.847750 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e26b293b-4d72-454a-91b2-3248f232308b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.392507 Jul 21 22:58:51.848328 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 391/827] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:51 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:51.850414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.850889 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.851647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.852078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.992691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:52.000542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3c5365bb-16d1-4086-bd47-25804935f25e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.161053 Jul 21 22:58:52.001100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 437/828] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:51 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:52.142301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:52.142940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:52.149087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.149543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.154370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.154370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.183180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:52.199704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=14 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:52.280910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:52.288976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e54068ac-4ab4-408c-b147-6210839a51dd tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.150564 Jul 21 22:58:52.292837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 392/829] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:52 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:52.810472 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:52.811106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:52.813086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=10 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:52.819054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.819497 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.820420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.820898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.865185 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:52.865873 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:52.872609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.873051 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.873813 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.874242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.950641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:52.958266 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e373d459-a475-4889-bc48-e4c405eb0983 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.151690 Jul 21 22:58:52.958867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 438/830] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:52 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:53.005763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:53.009095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:53.013503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e13c812e-4ce3-4fbd-b90e-5ae5584388c8 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1363 microversion: 2.1 time: 0.153125 Jul 21 22:58:53.014227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 393/831] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:52 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:53.017721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:53.018948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:53.024651 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.025104 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.025880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.026319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.168516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:53.177205 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5ca14e03-c6bf-401f-a5d9-60527b2fd19d tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.163440 Jul 21 22:58:53.184758 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 439/832] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:53 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:53.306412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:53.307128 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:53.313218 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.313672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.314439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.314913 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.454874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:53.462832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-54bab91a-4d49-447e-8876-4a4334fdeb0d tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.160726 Jul 21 22:58:53.463412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 394/833] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:53 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:53.974115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:53.975016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:53.981478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.981929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.982690 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.983159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.033448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.034080 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.040825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.041278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.042049 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.042486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.112431 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.120483 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-516bd0ab-b113-4d13-9b10-8b86187b3ae0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.150070 Jul 21 22:58:54.121298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 440/834] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:53 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:54.175137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.182698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-25019ced-4bb4-4faa-b64e-bdf63a48171d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1550 microversion: 2.1 time: 0.153194 Jul 21 22:58:54.183292 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 395/835] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:54.195092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.195725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.200445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.200939 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.201715 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.202164 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.202961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.203395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.207374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.214873 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.214873 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.214873 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.286158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-aa860094-0496-4b42-a140-18b5f6f9a94d tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089492 Jul 21 22:58:54.286846 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 396/836] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:54.347772 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.356366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a0673b0-5883-4bfa-ae0a-f3b0294bc115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.165162 Jul 21 22:58:54.356959 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 441/837] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:54.485562 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.486174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.489016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:54.501992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.501992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.501992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.501992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.757280 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.765515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-78caa6e3-bf2f-4ab1-b43a-2b3856cfe30a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.283864 Jul 21 22:58:54.766407 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 397/838] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:54.787832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-e718adc3-396a-49c0-bf85-55e480fdc44f req-7023c57a-ce6a-40ef-9aec-1e4e8ffd6d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fff0c7-83f1-445a-b6e0-32d1f5831ecb", "name": "network-vif-plugged", "status": "completed", "tag": "31ffe9d2-f878-4725-811a-0c9011087597"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:54.796371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e718adc3-396a-49c0-bf85-55e480fdc44f req-7023c57a-ce6a-40ef-9aec-1e4e8ffd6d06 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.796851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e718adc3-396a-49c0-bf85-55e480fdc44f req-7023c57a-ce6a-40ef-9aec-1e4e8ffd6d06 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.809055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-e718adc3-396a-49c0-bf85-55e480fdc44f req-7023c57a-ce6a-40ef-9aec-1e4e8ffd6d06 service nova] Creating event network-vif-plugged:31ffe9d2-f878-4725-811a-0c9011087597 for instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb on hv-cinder-85069 Jul 21 22:58:54.813838 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-e718adc3-396a-49c0-bf85-55e480fdc44f req-7023c57a-ce6a-40ef-9aec-1e4e8ffd6d06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Jul 21 22:58:54.818390 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 442/839] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:55.139248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:55.140010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.151007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.151472 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.152315 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.152767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.359620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:55.367012 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ccd10c62-f10a-4a78-a0f3-9d51da3c0f13 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.233294 Jul 21 22:58:55.367777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 398/840] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:55 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:55.375105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:55.375877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.383237 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.383780 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.384799 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.385294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.518351 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-a6731e87-3dd4-46f8-89ee-ce07e3b08a52 req-c00e31ff-9420-4b0d-8851-8c94b5a7b379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7af3cf9-8c87-41f9-a908-b12ca94202dd", "tag": "18c604d0-57b0-45a4-a124-d78abd64bf0c"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:55.528372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a6731e87-3dd4-46f8-89ee-ce07e3b08a52 req-c00e31ff-9420-4b0d-8851-8c94b5a7b379 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.528816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a6731e87-3dd4-46f8-89ee-ce07e3b08a52 req-c00e31ff-9420-4b0d-8851-8c94b5a7b379 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.542997 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-a6731e87-3dd4-46f8-89ee-ce07e3b08a52 req-c00e31ff-9420-4b0d-8851-8c94b5a7b379 service nova] Creating event network-changed:18c604d0-57b0-45a4-a124-d78abd64bf0c for instance f7af3cf9-8c87-41f9-a908-b12ca94202dd on hv-cinder-85069 Jul 21 22:58:55.548819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-a6731e87-3dd4-46f8-89ee-ce07e3b08a52 req-c00e31ff-9420-4b0d-8851-8c94b5a7b379 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034647 Jul 21 22:58:55.549857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 399/841] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:58:55.553187 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:55.561556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d67b8750-ca24-47c6-a48d-b11f1911c591 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.191261 Jul 21 22:58:55.568770 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 443/842] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:55 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:55.784509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:55.785204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.791431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.791880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.792670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.793155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.926119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:55.933617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6aafbe80-bbde-4dbc-a78d-065dfb0daccc tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1568 microversion: 2.1 time: 0.154290 Jul 21 22:58:55.934188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 400/843] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:55 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:55.950656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:55.951251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.957760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.958400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.959229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.959665 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.268929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-84fb3c12-0349-4256-8d4a-f555f2929142 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "POST /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71/action" status: 202 len: 0 microversion: 2.1 time: 0.321947 Jul 21 22:58:56.269544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 444/844] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 22:58:55 2022] POST /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:58:56.278019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:56.278629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:56.287508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.287508 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.287669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.287993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.388439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:56.389929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:56.397442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.398132 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.399297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.400152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.447268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:56.476876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6cdc1e3e-5725-42a0-9971-b5fc54443b3a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1576 microversion: 2.1 time: 0.201222 Jul 21 22:58:56.485930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 401/845] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:56 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:56.579977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:56.581204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:56.588158 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.588964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.590471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.591425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.602517 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:56.612213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3f19008c-9d25-4d67-94c5-86abef66b2b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1366 microversion: 2.1 time: 0.226925 Jul 21 22:58:56.623018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 445/846] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:56 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:56.786074 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:56.793968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-22839395-5372-4778-bd59-15f614da7eb6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.218395 Jul 21 22:58:56.794536 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 402/847] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:56 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:56.836475 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-65303997-16a6-4d24-9904-77f51a39a220 req-bc019aa1-d35d-45ce-8276-6383fc223e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "name": "network-vif-unplugged", "status": "completed", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:56.847361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-65303997-16a6-4d24-9904-77f51a39a220 req-bc019aa1-d35d-45ce-8276-6383fc223e22 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.848114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-65303997-16a6-4d24-9904-77f51a39a220 req-bc019aa1-d35d-45ce-8276-6383fc223e22 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.874229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-65303997-16a6-4d24-9904-77f51a39a220 req-bc019aa1-d35d-45ce-8276-6383fc223e22 service nova] Creating event network-vif-unplugged:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 22:58:56.874229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-65303997-16a6-4d24-9904-77f51a39a220 req-bc019aa1-d35d-45ce-8276-6383fc223e22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038526 Jul 21 22:58:56.874229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 446/848] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:57.494188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.494819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.501720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.502691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.503499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.503934 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.630430 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.631324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.633871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:57.638980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.639426 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.640190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.640620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.649317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:57.657652 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-172af039-b67d-4fd7-bd6a-271d8995c948 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1516 microversion: 2.1 time: 0.167195 Jul 21 22:58:57.662867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 403/849] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:57.784089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:57.793139 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e6f24b30-144a-44e9-aafb-aa29a1b4bc6a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1557 microversion: 2.1 time: 0.167416 Jul 21 22:58:57.793693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 447/850] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:57.809265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.809798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.815933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.815933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.816479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.816936 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.817565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.817690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.818011 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.818121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.818764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.819245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.837970 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:57.908341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ca81c00f-f876-41d0-8e2f-4bf173ef23fa tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096557 Jul 21 22:58:57.908341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 404/851] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:57.965614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:57.973656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-59309def-3721-41ee-ac6c-1d06bcd9866a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.166860 Jul 21 22:58:57.974246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 448/852] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:58.676650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:58.677384 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:58.683853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.684306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:58.685097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.685538 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:58.979517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:58.991933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:58.992529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:58.996199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cd5989db-664c-44bf-b545-d07b75322664 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1518 microversion: 2.1 time: 0.324688 Jul 21 22:58:59.002549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 405/853] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:58 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1518 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:59.003680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:59.004123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.004888 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:59.005311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.154877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:59.175383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e945a0c1-f41f-4c3f-8484-90922d70b9b5 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.187158 Jul 21 22:58:59.175986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 449/854] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:58 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:59.197844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-96ff13b2-f77a-452c-83cb-34471bb647f7 req-72306e7a-a8b8-46c5-a56c-1d80b9ffc552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35fff0c7-83f1-445a-b6e0-32d1f5831ecb", "tag": "31ffe9d2-f878-4725-811a-0c9011087597"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:59.206493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-96ff13b2-f77a-452c-83cb-34471bb647f7 req-72306e7a-a8b8-46c5-a56c-1d80b9ffc552 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:59.214544 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-96ff13b2-f77a-452c-83cb-34471bb647f7 req-72306e7a-a8b8-46c5-a56c-1d80b9ffc552 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.218242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-96ff13b2-f77a-452c-83cb-34471bb647f7 req-72306e7a-a8b8-46c5-a56c-1d80b9ffc552 service nova] Creating event network-changed:31ffe9d2-f878-4725-811a-0c9011087597 for instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb on hv-cinder-85069 Jul 21 22:58:59.223157 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-96ff13b2-f77a-452c-83cb-34471bb647f7 req-72306e7a-a8b8-46c5-a56c-1d80b9ffc552 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028963 Jul 21 22:58:59.223748 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 406/855] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:00.015155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:00.015945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:00.024160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.024612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.025397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.025836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.164842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:00.172956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a836e87a-e61f-45d5-b60d-e057243817a6 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.161813 Jul 21 22:59:00.173538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 450/856] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:00 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:00.194108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:00.195168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:00.201955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.202472 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.203488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.203955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.348806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:00.357062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-80f3cf6b-c410-4ebb-b9f9-40fd08895af7 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.168454 Jul 21 22:59:00.357626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 407/857] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:00 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:01.190678 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:01.191311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:01.197906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.198350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.199141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.199576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.334956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:01.342625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-07f4a043-2f9e-4d95-a2aa-1bb603c4e987 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.156636 Jul 21 22:59:01.343224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 451/858] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:01 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:01.374708 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:01.375398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:01.381915 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.382372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.383174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.383692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.530499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:01.538705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c7630fc3-9238-49f5-81c0-3d8b15efe115 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.167814 Jul 21 22:59:01.539322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 408/859] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:01 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:02.360374 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:02.360971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:02.368194 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.368633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.369380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.369802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.497801 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:02.505254 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6bdb5ebc-10db-467a-9aeb-5a4bdb7bbb86 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.148894 Jul 21 22:59:02.505807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 452/860] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:02 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:02.555718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:02.556325 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:02.562816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.563257 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.564015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.564478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.706963 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:02.714088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4f46018a-f042-4271-a2ec-73a03cfba536 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.162187 Jul 21 22:59:02.714662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 409/861] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:02 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:03.522089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:03.522702 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:03.529306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.529864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.530631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.531173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.659831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:03.667604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3f8fa8e1-4230-4340-b8cc-4033dbd59ed9 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.149449 Jul 21 22:59:03.668168 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 453/862] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:03 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:03.731793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:03.732454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:03.739771 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.740225 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.740988 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.741424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.886742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:03.895193 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-faef8fcf-d02a-4933-9322-5ad74d83523f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.167162 Jul 21 22:59:03.895769 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 410/863] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:03 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:04.684513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:04.685086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:04.692417 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.692869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.693633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.694067 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.826879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:04.834531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d3a6dbf-45d4-4a41-beb9-28471c4c7722 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.154071 Jul 21 22:59:04.835136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 454/864] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:04 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:04.912210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:04.912821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:04.919323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.919772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.920540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.920973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:05.060316 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:05.068182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9f01d54a-b398-4212-9d42-cf1656f257bd tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.159784 Jul 21 22:59:05.068750 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 411/865] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:04 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:05.852436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:05.853269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:05.859843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:05.860294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:05.861058 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:05.861552 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:05.989981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:05.997478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-35f63a55-143f-463e-ae7e-2481ccfa2329 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.149745 Jul 21 22:59:05.998039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 455/866] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:05 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:06.085695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:06.086304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:06.093763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.093763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.094013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.094451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.112459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:06.241666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:06.249615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4cf65a78-f9df-4ea2-b758-ab5c07b1a0a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.167794 Jul 21 22:59:06.250191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 412/867] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:06 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:07.014188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:07.014832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:07.021904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.022344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.023167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.023597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.159873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:07.167363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-49d8490e-c13f-467f-baf8-cad0a98b01aa tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.157271 Jul 21 22:59:07.167923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 456/868] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:07 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:07.268067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:07.268705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:07.275230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.275676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.276435 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.276866 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.416095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:07.424066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-91e8fb51-e079-4cc4-b7aa-e2c952e97c0f tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1758 microversion: 2.1 time: 0.160407 Jul 21 22:59:07.424634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 413/869] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:07 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:08.184440 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:08.185100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:08.191574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.192018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.192782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.193211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.350603 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:08.358158 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ab530eb-3954-4df5-a382-15f38fd6e960 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.177674 Jul 21 22:59:08.358722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 457/870] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:08 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:08.441171 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:08.441701 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:08.448175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.448620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.449374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.449803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.590038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:08.598735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-aedea5f0-0d6e-429c-821f-06e2f7ce28c2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1761 microversion: 2.1 time: 0.161518 Jul 21 22:59:08.599532 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 414/871] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:08 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:09.375735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:09.377459 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:09.384531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.385044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:09.386344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.386942 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:09.520963 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:09.528886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-63bc2f7e-f11f-4584-aab2-523c9fa0c95c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.157137 Jul 21 22:59:09.529453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 458/872] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:09 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:10.546557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:10.547192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:10.553233 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:10.553679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.554436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:10.554897 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.687342 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:10.695488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ea4c995a-46e4-48f9-8ae9-515b7367d83a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.152970 Jul 21 22:59:10.696063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 415/873] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:10 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:10.890629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-0f73d275-7f1c-4522-a852-2560ccf2d35c req-bfb96701-4fa2-493d-8246-b8aa5bc19471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "name": "network-vif-plugged", "status": "completed", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:10.898569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-0f73d275-7f1c-4522-a852-2560ccf2d35c req-bfb96701-4fa2-493d-8246-b8aa5bc19471 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:10.899252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-0f73d275-7f1c-4522-a852-2560ccf2d35c req-bfb96701-4fa2-493d-8246-b8aa5bc19471 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.910183 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-0f73d275-7f1c-4522-a852-2560ccf2d35c req-bfb96701-4fa2-493d-8246-b8aa5bc19471 service nova] Creating event network-vif-plugged:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 22:59:10.915217 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-0f73d275-7f1c-4522-a852-2560ccf2d35c req-bfb96701-4fa2-493d-8246-b8aa5bc19471 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148388 Jul 21 22:59:10.915840 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 459/874] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:11.394907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:11.395477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:11.401763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.402219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.403018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.403462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.483769 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lazy-loading 'services' on Instance uuid 1eaf8f01-0480-4896-bcb0-e1815f7ace90 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:59:11.681014 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ad73d870-d6ec-4be6-bde9-58261198cb30 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments/cce434a0-afcc-430f-b445-ddbe5b9e9dc7" status: 202 len: 0 microversion: 2.1 time: 0.290492 Jul 21 22:59:11.681668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 416/875] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 22:59:11 2022] DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments/cce434a0-afcc-430f-b445-ddbe5b9e9dc7 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:59:11.691381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:11.692334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:11.698493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.699029 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.699777 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.700204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.712731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:11.713425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:11.719751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.720200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.720968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.721412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.730998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1a11b5a2-d984-4c45-8468-fc6465b29dc3 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Jul 21 22:59:11.731561 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 460/876] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:59:11 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:11.853509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:11.861028 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-df94e7fd-7953-4ab0-ad0d-358147b6191c tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.152593 Jul 21 22:59:11.862364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 417/877] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:11 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:12.743528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:12.744456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:12.751148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.751537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.752310 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.752744 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.782740 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-75387b98-7377-4247-88ab-511ac3c42f31 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Jul 21 22:59:12.783840 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 461/878] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:59:12 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:12.879358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:12.880008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:12.886585 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.887039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.887810 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.888250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.023393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:13.031015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-23cf4332-d9b9-45a8-8def-1186694cf96e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1574 microversion: 2.1 time: 0.155578 Jul 21 22:59:13.031607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 418/879] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:12 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:13.794617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:13.795488 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:13.802582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:13.803068 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.803836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:13.804266 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.833007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d4558c42-6d59-46f4-a7d2-ecdee6a94382 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042424 Jul 21 22:59:13.833556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 462/880] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:59:13 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:14.049502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:14.050113 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:14.056669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.057122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.057888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.058330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.192052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:14.199523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fefb723d-3894-48f4-b067-4c3f1aadf1b3 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1561 microversion: 2.1 time: 0.154783 Jul 21 22:59:14.200100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 419/881] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:14 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:14.844641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:14.845579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:14.852485 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.852926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.853679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.854105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.882061 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ec1cf930-4c85-403f-8d1d-50c87b0e42af tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041444 Jul 21 22:59:14.882592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 463/882] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:59:14 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:59:14.959120 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:14.959619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:14.965666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.966121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.966927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.967368 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.991393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:59:15.315933 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-23c88b35-e9a6-4de2-9424-706de1e49121 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 204 len: 0 microversion: 2.1 time: 0.360909 Jul 21 22:59:15.316574 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 420/883] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:59:14 2022] DELETE /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:59:15.324422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:15.325036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:15.331078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.331523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.332280 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.332711 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.466186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:15.473680 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-86757f03-02e3-4aed-90bd-f1868ee97ded tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1690 microversion: 2.1 time: 0.153057 Jul 21 22:59:15.474242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 464/884] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:15 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:16.491847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:16.492456 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:16.499006 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.499451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:16.500206 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.500638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:16.632862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:16.640305 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9f677543-0a90-4d26-8f83-c35e25bb356b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1690 microversion: 2.1 time: 0.152964 Jul 21 22:59:16.640855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 421/885] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:16 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:17.657702 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:17.658938 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:17.665130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:17.665573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:17.666319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:17.666750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:17.796556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:17.800034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:17.804358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cc481fdf-91d2-4e97-8fa1-c81b788dd042 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1690 microversion: 2.1 time: 0.150597 Jul 21 22:59:17.804914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 465/886] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:17 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:18.821400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:18.821937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:18.828325 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.828777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.829543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.829980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.957755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:18.965324 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-90b4d065-c089-4412-9fb0-1870e15ecf65 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1690 microversion: 2.1 time: 0.148702 Jul 21 22:59:18.965932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 422/887] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:18 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:19.983442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:19.984128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:19.991761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:19.995250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:19.995250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:19.995250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.213687 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:20.221334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fd35eebd-f879-4a17-afff-099e6c079570 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1690 microversion: 2.1 time: 0.241713 Jul 21 22:59:20.230470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 466/888] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:19 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:20.706601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-7a9d062e-9e9c-4e67-9ae1-f6496cb3f6d3 req-dd40ec4e-4ca6-4ac3-8ca9-9b06ead58450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf8f01-0480-4896-bcb0-e1815f7ace90", "name": "network-vif-deleted", "tag": "8b9063ba-744d-4b47-833b-6351a6c5ac09"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:20.719842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-7a9d062e-9e9c-4e67-9ae1-f6496cb3f6d3 req-dd40ec4e-4ca6-4ac3-8ca9-9b06ead58450 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:20.720530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-7a9d062e-9e9c-4e67-9ae1-f6496cb3f6d3 req-dd40ec4e-4ca6-4ac3-8ca9-9b06ead58450 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.733035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-7a9d062e-9e9c-4e67-9ae1-f6496cb3f6d3 req-dd40ec4e-4ca6-4ac3-8ca9-9b06ead58450 service nova] Creating event network-vif-deleted:8b9063ba-744d-4b47-833b-6351a6c5ac09 for instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 on hv-cinder-85069 Jul 21 22:59:20.738611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-7a9d062e-9e9c-4e67-9ae1-f6496cb3f6d3 req-dd40ec4e-4ca6-4ac3-8ca9-9b06ead58450 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Jul 21 22:59:20.739197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 423/889] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:21.239344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:21.239886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:21.246798 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.247274 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.248054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.248493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.280952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.281402 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.281849 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lazy-loading 'fault' on Instance uuid 1eaf8f01-0480-4896-bcb0-e1815f7ace90 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:59:21.324933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:21.333623 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d7f5c89c-0dac-423d-9185-f85a5dd2427f tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 200 len: 1336 microversion: 2.1 time: 0.098185 Jul 21 22:59:21.334207 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 467/890] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:21 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:22.352625 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:22.353312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 1eaf8f01-0480-4896-bcb0-e1815f7ace90] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:22.359517 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.359962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.360717 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.361147 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.374700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] HTTP exception thrown: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Request method failure captured: Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 HTTP/1.1 Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djl5ylwvFwuVrwvAAx1miTGYbgUP0wxjDzIWQN_wotuovo_JjFSah6fPcyhqCTGKTnRinb0zYPJccMuNINNRm8OspiSPFukoU_9DFcd3MoPFKL0e2ofx90ja16Qblzqmg7Kg6XXKSVHpT0GN_dnqS5DzkOZulWWKQ0zzbfBHmieH9g Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:59:22.376402 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_755a70c4912f4795ae67cf9f036e02aa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4947466838974a71815561640fa55c14 Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. Jul 21 22:59:22.377964 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '1eaf8f01-0480-4896-bcb0-e1815f7ace90'} Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:59:22.380972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. Jul 21 22:59:22.382406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:22.383597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Returning 404 to user: Instance 1eaf8f01-0480-4896-bcb0-e1815f7ace90 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:59:22.383597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cbdefe12-db2c-495c-b679-d08dcfb03208 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90" status: 404 len: 111 microversion: 2.1 time: 0.030686 Jul 21 22:59:22.383597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 424/891] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:22 2022] GET /compute/v2.1/servers/1eaf8f01-0480-4896-bcb0-e1815f7ace90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:59:22.386538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-338691f6-d70d-445b-ba33-af03de89298d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '.version_select at 0x7fc5d74ead30>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:22.410241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:22.410685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:22.416707 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.417156 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.418023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.418462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.443851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e23ed4d7-46e9-40bc-8994-dca5a27b4137 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/ips" status: 200 len: 152 microversion: 2.20 time: 0.038099 Jul 21 22:59:22.444439 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 425/892] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Jul 21 22:59:22 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:59:22.459308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-338691f6-d70d-445b-ba33-af03de89298d tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063474939" status: 202 len: 0 microversion: 2.1 time: 0.076452 Jul 21 22:59:22.459894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 468/893] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 21 22:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063474939 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:59:24.961108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:24.961644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:24.964143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:24.969004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:24.969456 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:24.970222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:24.970705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:24.993777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lazy-loading 'flavor' on Instance uuid 8945f3f2-2423-4a04-a163-87c15c57bafe {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:59:25.217326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:25.595666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0e9790d8-b618-470a-9ed8-c3d0d24e060e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/action" status: 202 len: 0 microversion: 2.20 time: 0.639012 Jul 21 22:59:25.598703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 426/894] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 21 22:59:24 2022] POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:59:25.606301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:25.606939 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:25.613548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.613999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.614790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.615230 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.735201 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:25.735776 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:25.742491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.742974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.743741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.744176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.747942 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:25.756376 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:25.757908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:25.759103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1f5579e5-2a63-473d-ae57-ebf74453bfb8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.157509 Jul 21 22:59:25.759668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 469/895] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:25 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:25.769588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:59:26.043928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ef2fd8b1-7bd6-4f74-9240-b73885d3b51b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 204 len: 0 microversion: 2.1 time: 0.312604 Jul 21 22:59:26.044594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 427/896] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:59:25 2022] DELETE /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:59:26.054870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:26.055477 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:26.061648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.062092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.062885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.063345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.194900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:26.202328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-da489f4f-45ba-49f1-afd3-88ff8db37b98 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1506 microversion: 2.1 time: 0.151894 Jul 21 22:59:26.206273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 470/897] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:26 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:26.778094 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:26.778709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:26.784757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.785692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.786482 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.786944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.916290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:26.924235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:26.926362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:26.927542 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8539c475-1caf-4889-9f1d-ee8b67c07fd7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.153830 Jul 21 22:59:26.928104 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 428/898] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:26 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:27.219658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:27.220082 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:27.227544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.227996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.228757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.229192 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.354943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:27.362343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-105a4c1c-ade6-42f9-bac1-4aea274e6ba9 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1506 microversion: 2.1 time: 0.146866 Jul 21 22:59:27.362933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 471/899] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:27 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:27.946018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:27.946616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:27.954161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.954607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.955424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.955858 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.115682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.124606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.126131 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.127379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4bc5f7ad-cfc9-456a-a962-b5f10ab465f9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.186260 Jul 21 22:59:28.138657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 429/900] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:27 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:28.212864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-106e65e4-5c56-4a0f-831a-0cfd6908eeb7 req-8cd9a424-94ef-4685-b9f4-8cfcc34b0fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3616f76-15d6-4940-9c44-8cf771d3b170", "name": "network-vif-deleted", "tag": "d8513c0b-5706-4b5d-bf3c-154536ce5049"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:28.218905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:28.221961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-106e65e4-5c56-4a0f-831a-0cfd6908eeb7 req-8cd9a424-94ef-4685-b9f4-8cfcc34b0fce service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.223103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-106e65e4-5c56-4a0f-831a-0cfd6908eeb7 req-8cd9a424-94ef-4685-b9f4-8cfcc34b0fce service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.234265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-106e65e4-5c56-4a0f-831a-0cfd6908eeb7 req-8cd9a424-94ef-4685-b9f4-8cfcc34b0fce service nova] Creating event network-vif-deleted:d8513c0b-5706-4b5d-bf3c-154536ce5049 for instance d3616f76-15d6-4940-9c44-8cf771d3b170 on hv-cinder-85069 Jul 21 22:59:28.240062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-106e65e4-5c56-4a0f-831a-0cfd6908eeb7 req-8cd9a424-94ef-4685-b9f4-8cfcc34b0fce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 Jul 21 22:59:28.240672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 472/901] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:28.379357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:28.380047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:28.386203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.386662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.387471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.387910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.449381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.456862 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fed8a6e4-d3c3-4ee3-8ee3-9a0c621cdd04 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 200 len: 1292 microversion: 2.1 time: 0.081399 Jul 21 22:59:28.457834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 430/902] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:28 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:29.146865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.147503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.154341 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.155016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.155824 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.156239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.289400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:29.297449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:29.299002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:29.300140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ac4f87d9-ddcc-48c7-bf6f-32eb254a9f03 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.158377 Jul 21 22:59:29.300694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 473/903] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:29 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:29.473347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.474082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: d3616f76-15d6-4940-9c44-8cf771d3b170] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.480962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.481418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.482188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.482628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.496513 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] HTTP exception thrown: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Request method failure captured: Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 HTTP/1.1 Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djl5ylwvFwuVrwvAAx1miTGYbgUP0wxjDzIWQN_wotuovo_JjFSah6fPcyhqCTGKTnRinb0zYPJccMuNINNRm8OspiSPFukoU_9DFcd3MoPFKL0e2ofx90ja16Qblzqmg7Kg6XXKSVHpT0GN_dnqS5DzkOZulWWKQ0zzbfBHmieH9g Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 22:59:29.498163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_755a70c4912f4795ae67cf9f036e02aa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4947466838974a71815561640fa55c14 Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. Jul 21 22:59:29.499757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'd3616f76-15d6-4940-9c44-8cf771d3b170'} Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:59:29.500579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. Jul 21 22:59:29.501747 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 22:59:29.502839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Returning 404 to user: Instance d3616f76-15d6-4940-9c44-8cf771d3b170 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:59:29.502839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9432281b-1b66-4b39-814a-c0c8962b1473 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170" status: 404 len: 111 microversion: 2.1 time: 0.030153 Jul 21 22:59:29.502839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 431/904] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:29 2022] GET /compute/v2.1/servers/d3616f76-15d6-4940-9c44-8cf771d3b170 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:59:29.508782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.509269 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.515415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.515864 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.516612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.517039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.542492 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:59:29.849956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0d6466c8-dcbf-453d-b40d-3c37d5feade7 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 204 len: 0 microversion: 2.1 time: 0.344691 Jul 21 22:59:29.850548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 474/905] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 22:59:29 2022] DELETE /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:59:29.859108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.859659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.866294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.866752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.867543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.867985 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.003778 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.011387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fdd0a2b1-d495-469d-bf65-bcbe0bbdfcce tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.156283 Jul 21 22:59:30.011963 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 432/906] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:29 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:30.319373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:30.319986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:30.326633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:30.327116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.327883 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:30.328321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.458081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.466225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.467768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.468929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c159111e-fc69-41fe-ae19-55dfeb50a17c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.154059 Jul 21 22:59:30.469526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 475/907] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:30 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:31.028510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:31.029114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:31.035604 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.036047 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.036797 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.037228 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.178087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.185589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f1e93475-15c7-4922-a719-a236bad06c9b tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.160999 Jul 21 22:59:31.186246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 433/908] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:31 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:31.487749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:31.488993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:31.495627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.496079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.496855 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.497294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.624825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.632813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.634329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.635510 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-324c3fb9-ffc8-48f6-9456-83ff48291f4d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.151788 Jul 21 22:59:31.636066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 476/909] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:31 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:32.204954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:32.205534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:32.212617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.213076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.213843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.214282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.344204 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.351940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-54cf7e49-f841-4350-a266-0f30362275bc tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1520 microversion: 2.1 time: 0.150972 Jul 21 22:59:32.352512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 434/910] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:32 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:32.653474 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:32.654072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:32.660617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.661066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.661832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.662262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.793997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.802685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.804210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.805562 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1db30a8c-aeca-4a92-835c-2a3e88a6af05 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.156056 Jul 21 22:59:32.806116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 477/911] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:32 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:33.199891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-9da7d070-8e52-45aa-94a2-b0d28094b18c req-6bc33dd8-7f8d-478e-88a5-f5094a22d7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f21ad4b-325d-4945-91ee-58ed919e892c", "name": "network-vif-deleted", "tag": "2b3bc926-e36a-4b2b-a85a-0356b93dec8b"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:33.208506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9da7d070-8e52-45aa-94a2-b0d28094b18c req-6bc33dd8-7f8d-478e-88a5-f5094a22d7da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.211730 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9da7d070-8e52-45aa-94a2-b0d28094b18c req-6bc33dd8-7f8d-478e-88a5-f5094a22d7da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.219798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-9da7d070-8e52-45aa-94a2-b0d28094b18c req-6bc33dd8-7f8d-478e-88a5-f5094a22d7da service nova] Creating event network-vif-deleted:2b3bc926-e36a-4b2b-a85a-0356b93dec8b for instance 0f21ad4b-325d-4945-91ee-58ed919e892c on hv-cinder-85069 Jul 21 22:59:33.225379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-9da7d070-8e52-45aa-94a2-b0d28094b18c req-6bc33dd8-7f8d-478e-88a5-f5094a22d7da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029291 Jul 21 22:59:33.226398 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 435/912] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:59:33.369128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:33.369658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:33.375614 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.376063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.376825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.377259 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.438418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4947466838974a71815561640fa55c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755a70c4912f4795ae67cf9f036e02aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:33.446445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ee2ad108-df86-49cd-bd96-82219fe2fc47 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 200 len: 1306 microversion: 2.1 time: 0.081296 Jul 21 22:59:33.447034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 478/913] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:33 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 1306 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:33.824304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:33.824886 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:33.831045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.831489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.832878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.833304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.966606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:33.974572 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:33.976378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:33.977536 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fe7b8392-74aa-4a84-976c-76f2404b041f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.157610 Jul 21 22:59:33.978095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 436/914] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:33 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:34.463055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:34.463659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] [instance: 0f21ad4b-325d-4945-91ee-58ed919e892c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:34.470108 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.470555 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.471342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.471775 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.485875 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] HTTP exception thrown: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Request method failure captured: Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c HTTP/1.1 Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djl5ylwvFwuVrwvAAx1miTGYbgUP0wxjDzIWQN_wotuovo_JjFSah6fPcyhqCTGKTnRinb0zYPJccMuNINNRm8OspiSPFukoU_9DFcd3MoPFKL0e2ofx90ja16Qblzqmg7Kg6XXKSVHpT0GN_dnqS5DzkOZulWWKQ0zzbfBHmieH9g Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 22:59:34.487533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_755a70c4912f4795ae67cf9f036e02aa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/755a70c4912f4795ae67cf9f036e02aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 755a70c4912f4795ae67cf9f036e02aa Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509651646 Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 4947466838974a71815561640fa55c14 Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509651646-project Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. Jul 21 22:59:34.489672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '0f21ad4b-325d-4945-91ee-58ed919e892c'} Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:59:34.490505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. Jul 21 22:59:34.492014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 22:59:34.493334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] Returning 404 to user: Instance 0f21ad4b-325d-4945-91ee-58ed919e892c could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:59:34.493334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e4ba47da-462c-4b43-9aa4-7e2af6266d52 tempest-ServerRescueNegativeTestJSON-509651646 tempest-ServerRescueNegativeTestJSON-509651646-project] 10.222.0.52 "GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c" status: 404 len: 111 microversion: 2.1 time: 0.030376 Jul 21 22:59:34.493334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 479/915] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:34 2022] GET /compute/v2.1/servers/0f21ad4b-325d-4945-91ee-58ed919e892c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:59:34.995815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:34.996431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:35.003844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.004298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.005072 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.005507 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.135803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:35.143727 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:35.145295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:35.146399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0b7e0377-30a5-4314-90a4-f6148e7dd8d8 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.154606 Jul 21 22:59:35.147347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 437/916] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:34 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:36.163644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:36.164658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:36.172996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.173570 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:36.174631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.175225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:36.397343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:36.405795 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:36.407495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:36.408779 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a9a2e13b-2063-4d19-8aec-1f42707d8c6a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.249263 Jul 21 22:59:36.409580 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 480/917] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:36 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:37.426904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:37.427510 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:37.437546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:37.438166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:37.439283 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:37.440560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:37.713995 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:37.722144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:37.724276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:37.725669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-093ee936-9e2f-47a8-bbde-db1a4dd130d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.302826 Jul 21 22:59:37.736804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 438/918] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:37 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:38.744630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:38.745232 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:38.751769 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.752197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.752981 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.753407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.882053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:38.890063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:38.891683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:38.892822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6f814891-99b6-4ae1-b9ee-986051a20adc tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.152076 Jul 21 22:59:38.893372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 481/919] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:38 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:39.911482 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:39.912496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:39.919234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.919779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:39.920558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.921011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:40.049965 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:40.058810 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:40.060546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:40.061608 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-535cbab0-d471-4edd-8561-8488256e4c4a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.154572 Jul 21 22:59:40.062164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 439/920] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:39 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:41.080703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:41.081353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:41.088778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:41.089303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:41.090322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:41.090920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:41.224419 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:41.228225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:41.233073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:41.234582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:41.235765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b3c72b50-14f1-496d-90c1-044ec074d4bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.159335 Jul 21 22:59:41.236320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 482/921] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:41 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:59:42.254810 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:42.255619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:42.262396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.263013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.263877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.264389 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.409563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:42.418093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:42.420864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:42.422143 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-88414a3b-5682-403b-90df-258a498ccb13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.172485 Jul 21 22:59:42.422812 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 440/922] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:42 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:43.441956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:43.442648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:43.449576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.450024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:43.450818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.451447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:43.587415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:43.595514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:43.597022 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:43.598193 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-67f834ac-5fdc-4e47-876e-60d9aa638ce4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.161149 Jul 21 22:59:43.598882 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 483/923] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:43 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:44.615948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:44.616549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:44.623196 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:44.623647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:44.624669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:44.625115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:44.763586 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:44.772045 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:44.773770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:44.775076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f5634d0e-33b5-4c6e-aecb-dc00d511a30f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.163020 Jul 21 22:59:44.775704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 441/924] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:44 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:45.793392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:45.794065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:45.800572 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.801019 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.801820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.802298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.934820 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:45.943766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:45.945334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:45.946572 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-aa3cddba-86ef-43e8-b3ae-29b7570246db tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.157121 Jul 21 22:59:45.947142 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 484/925] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:45 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:46.230289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:46.230901 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:46.237473 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.238561 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.239363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.239796 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.267085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9666cf92-4320-4d9a-b28c-8f0e3d0019ef tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/ips" status: 200 len: 145 microversion: 2.1 time: 0.040902 Jul 21 22:59:46.267656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 442/926] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:59:46 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:46.964924 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:46.965659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:46.966167 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:46.966805 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:46.972400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.974202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.974314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.974407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.974494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.974579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.974688 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.975070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:47.004788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:47.014788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-61345eb9-6f82-49f6-9a8b-11da38215817 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/ips" status: 200 len: 151 microversion: 2.1 time: 0.052425 Jul 21 22:59:47.015381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 443/927] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 22:59:46 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:59:47.115794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:47.123623 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:47.125162 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:47.126320 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4e0bef85-5f1e-4b23-9ec3-48beab7e0e7d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1743 microversion: 2.20 time: 0.165448 Jul 21 22:59:47.127103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 485/928] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:46 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:47.879892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b074cca-09e6-4e53-a411-7273f65d2d83"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:47.881002 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:47.888222 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.888674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:47.889445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.889880 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.146408 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:48.147042 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:48.153536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.154030 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.154891 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.155330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.289286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:48.297152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:48.298648 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:48.299808 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-343c8785-ea1a-44ee-868d-b811a99150fa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1743 microversion: 2.20 time: 0.158484 Jul 21 22:59:48.300392 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 486/929] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:48 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:59:48.624447 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b394ed22-02f1-4f2e-9b67-b967fa8a9b6f"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:48.625507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:48.632253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.632716 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.633567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.634001 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.740336 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2ee555ea-49d6-48aa-a2fd-0f92b756502e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864425 Jul 21 22:59:48.740968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 444/930] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:59:47 2022] POST /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:49.318426 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:49.324393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:49.329498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.330011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.330869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.331304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.451385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-23b5440a-59a6-4ef1-9c0d-ad5e6127521e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830624 Jul 21 22:59:49.457422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 487/931] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:59:48 2022] POST /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:59:49.463523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:49.477242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:49.478790 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:49.479966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-90c59abe-8541-4cb2-be33-c436db59eb7b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1743 microversion: 2.20 time: 0.165938 Jul 21 22:59:49.480522 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 445/932] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:49 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:59:50.500573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:50.501384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:50.513830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.514626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.515537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.516096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.668065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:50.679782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:50.679782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:50.681122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-76140059-3e9a-46a3-945d-f0029e9ea851 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.185681 Jul 21 22:59:50.695686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 488/933] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:50 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:50.955879 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-8a499e80-d8cb-47d3-9d9c-3b259412a7c3 req-9100ac74-e982-451e-a760-02b385b91958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "name": "network-vif-plugged", "status": "completed", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:50.966691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8a499e80-d8cb-47d3-9d9c-3b259412a7c3 req-9100ac74-e982-451e-a760-02b385b91958 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.967246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-8a499e80-d8cb-47d3-9d9c-3b259412a7c3 req-9100ac74-e982-451e-a760-02b385b91958 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.979728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-8a499e80-d8cb-47d3-9d9c-3b259412a7c3 req-9100ac74-e982-451e-a760-02b385b91958 service nova] Creating event network-vif-plugged:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 22:59:50.984703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-8a499e80-d8cb-47d3-9d9c-3b259412a7c3 req-9100ac74-e982-451e-a760-02b385b91958 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Jul 21 22:59:50.985704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 446/934] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 22:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:51.703574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:51.705303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:51.712582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:51.713334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:51.714195 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:51.714860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:51.866911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:51.875784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:51.877288 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:51.878540 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2d322db9-9a92-4cad-91d0-ac437cd095d1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.179126 Jul 21 22:59:51.889107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 489/935] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:51 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:52.898608 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:52.899380 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:52.905895 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.906341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:52.907694 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.908130 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:53.081273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:53.089672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:53.091241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:53.092394 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bd6da9f1-73c3-457c-a660-7e7928c39a13 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.199310 Jul 21 22:59:53.092949 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 447/936] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:52 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:54.111903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:54.112520 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:54.122611 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.127296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.128528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.129389 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.324397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:54.335751 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:54.337279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:54.338458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1d67cc7c-cd87-4c80-ad9f-4b92d2974e68 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.231174 Jul 21 22:59:54.339156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 490/937] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:54 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:55.357755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:55.362938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:55.362938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:55.367003 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.367654 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.368610 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.369209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.553024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:55.561859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:55.563668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:55.565096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bfb23197-3fce-4b20-a1af-5f150eb60121 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.211323 Jul 21 22:59:55.576217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 448/938] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:55 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:56.352297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:56.353549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:56.360818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.440660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.440660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.440660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.440660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4097268f-efdf-4274-b1d8-f60e3a839ee2 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050341 Jul 21 22:59:56.441684 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 491/939] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 22:59:56 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:56.450189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:56.450798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:56.457479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.458009 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.458962 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.459404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.490358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2ed11e6a-3a0c-44b7-87ee-c5a1b74b874a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83" status: 200 len: 194 microversion: 2.1 time: 0.044241 Jul 21 22:59:56.495737 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 449/940] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 21 22:59:56 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:56.582717 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:56.583450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:56.589458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.589908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.590726 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.591184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.757357 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:56.767809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:56.770268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:56.771539 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3871986b-91ee-41bc-a4d6-f0ba53f45a9f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.192761 Jul 21 22:59:56.772516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 492/941] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:56 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:57.790691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:57.791612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:57.806459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.806985 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:57.807906 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.808367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:57.990586 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:57.999762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:58.002375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:58.003559 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-272c19f7-fc09-47e6-aae1-3d34465f542b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.217551 Jul 21 22:59:58.004117 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 450/942] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:57 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:58.307514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2598ef79-7ff0-4f0d-9e34-8707f6a34913"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:58.308647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:58.316857 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:58.317584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:58.321246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:58.321246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:58.996830 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fb071bf2-7b1b-4b49-9db4-d6fac0157e7a tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "POST /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693626 Jul 21 22:59:59.004674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 493/943] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 22:59:58 2022] POST /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:59:59.026087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:59.027644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:59.035675 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.036681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.038436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.039162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.227885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-164439837", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "networks": [{"uuid": "818409ac-b84e-41b9-a0f7-dd64c062b10f"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:59:59.246275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:59.315572 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] validate_networks() for [('818409ac-b84e-41b9-a0f7-dd64c062b10f', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:59:59.534016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:59.543552 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:59.545391 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:59.546958 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d58bf2ac-87bc-46e6-9cf3-60ea85bb5978 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.528823 Jul 21 22:59:59.547720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 451/944] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 22:59:59 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:59:59.721515 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:59:59.721929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:59:59.722920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:59:59.723328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:59:59.723736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:59:59.732682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.733122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.733918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.734342 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.751658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Getting quotas for project 3429139a6e494a7290d91dd3cb8f712c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:59:59.755523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Getting quotas for user 932c6d0ae774493a852781e4c8d83e67 and project 3429139a6e494a7290d91dd3cb8f712c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:59:59.766451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:59:59.768832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:00:00.067221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4f11c619-03ce-42c8-82db-afb48549c188 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846042 Jul 21 23:00:00.068146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 494/945] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 22:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:00:00.080821 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6c6fd64a-efb7-482a-978d-bfc9138251bf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:00.082543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6c6fd64a-efb7-482a-978d-bfc9138251bf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:00.175241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6c6fd64a-efb7-482a-978d-bfc9138251bf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:00.190765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6c6fd64a-efb7-482a-978d-bfc9138251bf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1213 microversion: 2.1 time: 0.115019 Jul 21 23:00:00.191959 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 452/946] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:00 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:00.566393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:00.569818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:00.573746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:00.574199 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:00.575044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:00.575481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:00.718094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:00.727577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:00.729284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:00.730474 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-56d2d90d-734b-462f-988e-6f2a887f068b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1738 microversion: 2.20 time: 0.168440 Jul 21 23:00:00.731295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 495/947] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:00 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:01.212061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c6393947-a31a-4721-94e4-e54a5a9de13f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:01.212679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c6393947-a31a-4721-94e4-e54a5a9de13f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:01.267249 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c6393947-a31a-4721-94e4-e54a5a9de13f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.273980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c6393947-a31a-4721-94e4-e54a5a9de13f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1213 microversion: 2.1 time: 0.065955 Jul 21 23:00:01.274534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 453/948] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:01 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:01.750318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:01.750980 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:01.758592 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.759072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.759861 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.760295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.891270 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.900383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.901999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.903123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-056f71f5-7bcc-49e1-80fc-54ea5aa5534e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1720 microversion: 2.20 time: 0.156882 Jul 21 23:00:01.903695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 496/949] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:01 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:02.290863 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:02.291479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:02.298170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.298625 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.299447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.299887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.384406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:02.392179 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-28f9c03d-baaf-4555-801e-5468039e2bb7 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1265 microversion: 2.1 time: 0.105210 Jul 21 23:00:02.392752 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 454/950] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:02 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:02.921534 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:02.922136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:02.929242 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.929710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.930448 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.930908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.950011 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:03.063621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.071377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.072872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.074006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4036a9c0-2cee-4059-a56f-e61464f037f1 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1720 microversion: 2.20 time: 0.156418 Jul 21 23:00:03.074568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 497/951] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:02 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:03.409016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:03.410265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:03.416735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.417181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.417941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.418374 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.485064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.492432 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-18893dd0-a89e-4a48-8354-774a9f7c1ac3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1265 microversion: 2.1 time: 0.087229 Jul 21 23:00:03.493005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 455/952] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:03 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:04.093253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:04.093853 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:04.100381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.100829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.101844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.102278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.230325 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.239121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.240631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.241772 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4d055a9a-856f-450f-b69a-501643a16e90 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1720 microversion: 2.20 time: 0.152824 Jul 21 23:00:04.242331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 498/953] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:04 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:04.515819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:04.516422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:04.522940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.523381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.524144 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.524601 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.587647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.594945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-49fdfd98-bb0f-456e-b728-18a42e650567 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1273 microversion: 2.1 time: 0.082930 Jul 21 23:00:04.598691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 456/954] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:04 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:05.266844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:05.269516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:05.277286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.277868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.278747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.279298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.432049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:05.439994 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:05.442135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:05.443371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2414be55-eb1f-4564-aa61-3e7fc88f6f38 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1723 microversion: 2.20 time: 0.186566 Jul 21 23:00:05.443979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 499/955] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:05 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:05.460837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8246025-5e03-4125-a162-1e57438c4a4c"}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:05.462010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:05.468020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.468467 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.469232 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.469666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.614306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:05.618632 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:05.621457 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.622028 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.622880 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.623386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.763899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:05.771373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4a956f8d-2c8b-4118-9c30-4c9b69c41cf3 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.161551 Jul 21 23:00:05.771941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 500/956] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:05 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:05.776575 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b394ed22-02f1-4f2e-9b67-b967fa8a9b6f"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:05.777685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:05.783995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.785233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.785993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.786590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.985127 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: POST /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments HTTP/1.1 Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 74 Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:05.986886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {"volumeAttachment": {"volumeId": "b394ed22-02f1-4f2e-9b67-b967fa8a9b6f"}} Jul 21 23:00:05.989188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'server_id': '35fff0c7-83f1-445a-b6e0-32d1f5831ecb', 'body': {'volumeAttachment': {'volumeId': 'b394ed22-02f1-4f2e-9b67-b967fa8a9b6f'}}} Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:05.990083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:05.991546 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 400 to user: Invalid volume: volume b394ed22-02f1-4f2e-9b67-b967fa8a9b6f is already attached to instances: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-47a86d61-ec50-45de-b3aa-f2e0e970bfba tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216233 Jul 21 23:00:05.994143 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 501/957] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 23:00:05 2022] POST /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:00:06.052255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.052757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.058863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.059308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.060105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.060574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.141760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'services' on Instance uuid 35fff0c7-83f1-445a-b6e0-32d1f5831ecb {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:06.353154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-39e056ff-0033-49fe-9412-da5fea41c22d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments/b394ed22-02f1-4f2e-9b67-b967fa8a9b6f" status: 202 len: 0 microversion: 2.1 time: 0.305306 Jul 21 23:00:06.353737 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 502/958] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:00:06 2022] DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments/b394ed22-02f1-4f2e-9b67-b967fa8a9b6f => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:00:06.363260 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.364348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.370920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.371366 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.372131 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.372564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.403425 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ba34ddae-e443-416f-9ce6-5cdfb34566bf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 Jul 21 23:00:06.404016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 503/959] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:06 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:06.478140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-e7c9a00e-02e7-4226-a676-e28637e6f68f req-9423f490-75cd-49fb-88f3-e7c59ff0ace4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ceb58b-5c05-426a-be36-7ea89f4ac6a6", "tag": "96d520a8-b232-41e7-8da8-0ec35d964762"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:06.487046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e7c9a00e-02e7-4226-a676-e28637e6f68f req-9423f490-75cd-49fb-88f3-e7c59ff0ace4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.487586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e7c9a00e-02e7-4226-a676-e28637e6f68f req-9423f490-75cd-49fb-88f3-e7c59ff0ace4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.508370 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-e7c9a00e-02e7-4226-a676-e28637e6f68f req-9423f490-75cd-49fb-88f3-e7c59ff0ace4 service nova] Creating event network-changed:96d520a8-b232-41e7-8da8-0ec35d964762 for instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 on hv-cinder-85069 Jul 21 23:00:06.513233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-e7c9a00e-02e7-4226-a676-e28637e6f68f req-9423f490-75cd-49fb-88f3-e7c59ff0ace4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040697 Jul 21 23:00:06.513845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 504/960] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:06.615294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-de15c419-2c0a-4134-8a9a-d40aa5cf5b7a tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.158303 Jul 21 23:00:06.615926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 457/961] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Jul 21 23:00:05 2022] POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments => generated 188 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:00:06.731375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.731957 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.738414 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.738941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.739728 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.740167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.788690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.789540 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.796491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.796951 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.797712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.798148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.024757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.028211 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:07.032612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f07cba31-65ce-4475-b86d-88966b242487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.247943 Jul 21 23:00:07.033195 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 458/962] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:06 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:07.039322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-e9a46ef2-5617-46f6-9f1c-7fe95111cdb5 req-6f84eae5-3518-4487-87a8-7b05b63ac98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "name": "network-vif-unplugged", "status": "completed", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:07.047739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e9a46ef2-5617-46f6-9f1c-7fe95111cdb5 req-6f84eae5-3518-4487-87a8-7b05b63ac98d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.053672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e9a46ef2-5617-46f6-9f1c-7fe95111cdb5 req-6f84eae5-3518-4487-87a8-7b05b63ac98d service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.061598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.compute.server_external_events [req-e9a46ef2-5617-46f6-9f1c-7fe95111cdb5 req-6f84eae5-3518-4487-87a8-7b05b63ac98d service nova] Unable to find a host for instance 8945f3f2-2423-4a04-a163-87c15c57bafe. Dropping event network-vif-unplugged {{(pid=124924) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 23:00:07.062700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-e9a46ef2-5617-46f6-9f1c-7fe95111cdb5 req-6f84eae5-3518-4487-87a8-7b05b63ac98d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028567 Jul 21 23:00:07.063375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 459/963] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 23:00:07.389577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dd7c6fda-9c56-4550-91cd-ff8683c3eaa5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments/f8246025-5e03-4125-a162-1e57438c4a4c" status: 202 len: 0 microversion: 2.20 time: 0.662904 Jul 21 23:00:07.390202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 505/964] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Jul 21 23:00:06 2022] DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments/f8246025-5e03-4125-a162-1e57438c4a4c => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:00:07.415405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:07.416337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:07.422811 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.423343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.424015 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.424488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.449948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:07.450650 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:07.454696 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c83bf840-1d9f-4b53-8751-a94ddf894456 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Jul 21 23:00:07.455395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 460/965] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:07 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:07.457637 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.458161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.459034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.459542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.677100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ddc33b78-91c0-4e43-9fde-b9bac19664f5 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/action" status: 202 len: 0 microversion: 2.20 time: 0.231098 Jul 21 23:00:07.678020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 506/966] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Jul 21 23:00:07 2022] POST /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:00:07.686714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:07.687358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:07.694930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.695380 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.696209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.696700 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.828035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.836063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.837622 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.838835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-eead8724-ba1d-422d-9ab1-14c50ea75261 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1671 microversion: 2.20 time: 0.156573 Jul 21 23:00:07.839405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 461/967] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:07 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:08.049919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:08.051146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:08.057396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.057853 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.058644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.059095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.198305 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:08.206514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2bc44da5-4038-4b98-8190-ba4a0fa18b9d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.160794 Jul 21 23:00:08.207746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 507/968] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:08 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:08.471443 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:08.472980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:08.480165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.480611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.481851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.511311 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d69fda0c-d20c-446f-85b4-e500263ad3ef tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047568 Jul 21 23:00:08.511877 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 462/969] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:08 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:08.857664 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:08.859721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:08.864877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.865326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.866086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.866518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.997180 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.005566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.007136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.008302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1de8ca99-a616-4a25-942e-1e6b00eb1558 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1673 microversion: 2.20 time: 0.154582 Jul 21 23:00:09.008857 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 508/970] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:08 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:00:09.223853 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:09.224462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:09.231329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.231774 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.232538 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.232977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.448682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.456330 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6f19eca9-1bbc-4a57-a075-6f2dbb9e6487 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.236324 Jul 21 23:00:09.456816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 463/971] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:09 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:09.522121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:09.523121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:09.529332 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.529792 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.530615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.531081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.563621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f83a4da1-b9ec-4787-a927-88c6c439c351 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 Jul 21 23:00:09.564186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 509/972] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:09 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:10.027373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:10.027981 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:10.033912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.034363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.035724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.036164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.172666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:10.180719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:10.182242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:10.183431 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9981b4ac-1902-47d8-94d8-00bcdf9c80bf tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.159998 Jul 21 23:00:10.194598 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 464/973] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:10 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:10.474437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:10.476100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:10.482455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:10.483904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:10.486498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.487086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.487972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.488686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.577400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:10.579777 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:10.589841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.590676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.591705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.593616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.658347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e2c66b4f-4929-4f58-b664-91a62eaada7c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085213 Jul 21 23:00:10.659632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 465/974] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:10 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:10.704312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:10.706746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:10.716340 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e6e68bf5-9c19-4e63-a1b4-3da0fe27faf5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.246049 Jul 21 23:00:10.717035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 510/975] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:10 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:11.203966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:11.205091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:11.218865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.219339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.220176 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.220788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.271759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=4 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:11.376706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.386341 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.388113 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.389564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-66161f94-abee-4f11-a9d0-8522dabb3e47 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.191872 Jul 21 23:00:11.390302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 466/976] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:11 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:11.669554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:11.670482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:11.678275 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.678732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.679622 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.680094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.720633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6df0cc40-d38a-418b-8882-364eb270687a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054959 Jul 21 23:00:11.721206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 511/977] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:11 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:11.735106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:11.735699 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:11.743893 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.744340 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.745100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.745725 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.893767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.901731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b261c689-1e36-4d8b-b6e5-f46d7cd8c6c5 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.170488 Jul 21 23:00:11.902644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 467/978] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:11 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:12.223840 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-789023141"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:12.224484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.231303 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.231824 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.232696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.235256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.392705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.network.security_group_api [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Removing security group 0eb4bfcd-0b5d-4967-b47c-d2701c1b76a0 from port f2c971ef-1e12-4937-8388-d94ceee5e560 Jul 21 23:00:12.408740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:12.410253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.416595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.417349 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.418520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.419199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.583068 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:12.592623 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:12.594210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:12.595561 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-889abae0-460a-4cca-bfb8-ec80d186b38e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.191133 Jul 21 23:00:12.596550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 468/979] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:12 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:00:12.733498 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:12.734711 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.742973 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.744288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.745244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.745719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.786744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-36dc4a61-edcc-423e-99db-af492c9f28e8 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057276 Jul 21 23:00:12.791530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 469/980] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:12 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:12.920907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:12.921733 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.929979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.155841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.155841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.155841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.156251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:13.156251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e15e4534-6945-45ac-a895-b1733b75bce0 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.163696 Jul 21 23:00:13.156251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 470/981] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:12 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:13.434016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-444978ac-d219-40a5-9e3a-edc87d73e1cb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action" status: 202 len: 0 microversion: 2.1 time: 1.211910 Jul 21 23:00:13.434016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 512/982] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Jul 21 23:00:12 2022] POST /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/action => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:00:13.445139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-5169373e-157a-409a-8c0e-ae84625e2a8b req-8d404898-7112-42dc-8403-6942a31650d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:13.472890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-5169373e-157a-409a-8c0e-ae84625e2a8b req-8d404898-7112-42dc-8403-6942a31650d0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.473371 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-5169373e-157a-409a-8c0e-ae84625e2a8b req-8d404898-7112-42dc-8403-6942a31650d0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.510596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-5169373e-157a-409a-8c0e-ae84625e2a8b req-8d404898-7112-42dc-8403-6942a31650d0 service nova] Creating event network-changed:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 23:00:13.518375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-5169373e-157a-409a-8c0e-ae84625e2a8b req-8d404898-7112-42dc-8403-6942a31650d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078781 Jul 21 23:00:13.520248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 471/983] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:13.615482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:13.616742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:13.639626 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.640353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.641308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.641897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.806697 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:13.812078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:13.845907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.845907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.845907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.845907 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.889748 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:13.905534 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:13.913371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:13.915150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5fa37f7b-b182-4388-a012-3f2a128e05aa tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.304206 Jul 21 23:00:13.921048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 513/984] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:13 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:13.932472 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-31cd9b8d-8022-4ade-a2b8-5306276398a5 req-a6397005-c027-4f3a-a4df-eef617aaa929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ceb58b-5c05-426a-be36-7ea89f4ac6a6", "name": "network-vif-plugged", "status": "completed", "tag": "96d520a8-b232-41e7-8da8-0ec35d964762"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:13.937514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4e1f0c94-944e-4ffc-9a7c-91ae4dd7a28e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140911 Jul 21 23:00:13.944860 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 472/985] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:13 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:13.971057 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-31cd9b8d-8022-4ade-a2b8-5306276398a5 req-a6397005-c027-4f3a-a4df-eef617aaa929 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.972018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-31cd9b8d-8022-4ade-a2b8-5306276398a5 req-a6397005-c027-4f3a-a4df-eef617aaa929 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.984333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-31cd9b8d-8022-4ade-a2b8-5306276398a5 req-a6397005-c027-4f3a-a4df-eef617aaa929 service nova] Creating event network-vif-plugged:96d520a8-b232-41e7-8da8-0ec35d964762 for instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 on hv-cinder-85069 Jul 21 23:00:13.999288 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-31cd9b8d-8022-4ade-a2b8-5306276398a5 req-a6397005-c027-4f3a-a4df-eef617aaa929 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074252 Jul 21 23:00:14.000206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 514/986] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:14.172483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:14.173089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:14.182818 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.184948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.199497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.206891 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.721151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:14.729717 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-af8423a8-11ba-4a3a-a07f-a7984481aecc tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.561758 Jul 21 23:00:14.741489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 473/987] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:14 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:14.940449 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:14.941945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:14.948986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.950092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.950544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.951031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.955509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:14.956499 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:14.967254 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.968607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.969602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.970194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.019692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-779e3f3a-e118-4643-8124-6c1d12753c53 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067979 Jul 21 23:00:15.021016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 474/988] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:14 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:15.131891 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.141015 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.142859 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.144268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-80a94f6e-d607-489f-a724-69755e0f4680 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.209086 Jul 21 23:00:15.155428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 515/989] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:14 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:15.505871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:15.506365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:15.519329 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.519544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-c187a6cd-7a05-4646-8d53-2896902624a1 req-3b592f39-9c6f-4ed5-85a5-b5d111cff542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:15.520275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.521685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.523785 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.530766 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-c187a6cd-7a05-4646-8d53-2896902624a1 req-3b592f39-9c6f-4ed5-85a5-b5d111cff542 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.531533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-c187a6cd-7a05-4646-8d53-2896902624a1 req-3b592f39-9c6f-4ed5-85a5-b5d111cff542 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.547617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-c187a6cd-7a05-4646-8d53-2896902624a1 req-3b592f39-9c6f-4ed5-85a5-b5d111cff542 service nova] Creating event network-changed:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 23:00:15.553597 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-c187a6cd-7a05-4646-8d53-2896902624a1 req-3b592f39-9c6f-4ed5-85a5-b5d111cff542 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037874 Jul 21 23:00:15.558400 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 516/990] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:15.651793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lazy-loading 'services' on Instance uuid a4af0c74-4e0a-4b83-abb6-bdf7216abe88 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:15.749602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:15.750418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:15.762765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.763265 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.764078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.764533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.862705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7324c841-8003-450e-92b7-9b6d5cf41370 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments/0aeb9f1e-ac9e-4944-81a5-f4140399ab1d" status: 202 len: 0 microversion: 2.1 time: 0.360584 Jul 21 23:00:15.864139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 475/991] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:00:15 2022] DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments/0aeb9f1e-ac9e-4944-81a5-f4140399ab1d => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:00:15.888571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:15.893210 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:15.908133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.908687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.910105 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.910631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.932742 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:15.945643 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-18f21890-21a0-4ba8-8259-4a8580453727 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076559 Jul 21 23:00:15.950692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 476/992] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:15 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:15.988905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.997233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4e486570-a857-42ba-9868-0dc29361a85a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.252057 Jul 21 23:00:15.998711 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 517/993] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:15 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:16.032156 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:16.033920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:16.042216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.043106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.044323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.044983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.079021 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f81517b8-6c94-48de-bfd8-a626dfa0b221 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051187 Jul 21 23:00:16.080019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 477/994] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:16 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:16.164312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:16.165284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:16.172052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.172898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.173925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.174631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.365406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:16.375445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:16.377516 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:16.379823 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e0c32aa9-7074-4c85-b622-3487b8872698 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.220206 Jul 21 23:00:16.392524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 518/995] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:16 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:16.957966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:16.958832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:16.965170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.978713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.978713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.978713 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.997531 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e8c38e40-ea7a-46e4-ad4c-ea2039795d29 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Jul 21 23:00:17.001529 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 478/996] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:16 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:17.020345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:17.020345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:17.026590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.027077 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.027879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.028317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.098339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:17.101058 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:17.112220 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.113546 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.121100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.121100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.155419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-59b0ab9b-2ffc-4737-b653-2d2e7bb61c5f tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062987 Jul 21 23:00:17.156205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 479/997] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:17 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:17.196635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.212352 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-93f5726f-23fb-47b4-b9b8-5433d9ddb36d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.200107 Jul 21 23:00:17.212873 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 519/998] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:17 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:17.407526 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:17.409061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:17.417857 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.418683 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.419834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.420983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.614285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.623829 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.625634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.626933 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ecbdde13-2723-4b6a-9516-6bbbb7a01f34 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.226207 Jul 21 23:00:17.627578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 480/999] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:17 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:00:18.010858 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:18.011900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:18.018216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.019053 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.019828 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.020256 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.054665 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-34b018b0-7d12-468e-91c2-9648b49f83fa tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047373 Jul 21 23:00:18.054665 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 520/1000] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:18 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:18.167366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:18.168299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:18.175422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.176119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.177069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.177762 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.209261 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2b392afe-39c7-4b48-b2ec-efdb038a33b1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Jul 21 23:00:18.209855 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 481/1001] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:18 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:18.232471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:18.233919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:18.241179 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.241982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.243047 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.243809 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.384457 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:18.392813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ea0e0820-0a62-4c9a-8853-9134d4150803 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.167522 Jul 21 23:00:18.401289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 521/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:18 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:18.646551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:18.647183 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:18.653169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.653610 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.654357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.654830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.791491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:18.792944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:18.794463 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:18.795660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8b768966-430d-4266-9e2f-dd42cd45ad3d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.153793 Jul 21 23:00:18.796227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 482/1003] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:18 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:19.064802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.066371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.072824 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.073289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.074035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.074460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.102532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4eac6fd4-10e6-4281-832a-26eab2c83c82 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Jul 21 23:00:19.103112 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 522/1004] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:19.221071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.222494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.229387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.229839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.230605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.231077 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.271288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-83bd7a0c-b7f3-4f00-b0fd-d18f682e7b37 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054107 Jul 21 23:00:19.275592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 483/1005] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:19.410025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.410799 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.417087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.419679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.419679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.419679 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.549843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.557965 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4181d0a8-c9c4-4c6a-88ac-43d2859b9d97 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.152421 Jul 21 23:00:19.558541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 523/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:19.814365 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.814924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.821578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.822026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.822808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.823251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.955883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.964707 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.966265 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.967464 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-47bdf216-4b2e-4d30-8c45-2df056b3a60c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.157135 Jul 21 23:00:19.968023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 484/1007] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:20.113663 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.114752 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.125389 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.126101 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.126904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.127351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.158243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e3faeebb-eb48-4d7f-ae3e-29bbf663d2b1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048562 Jul 21 23:00:20.170391 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 524/1008] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:20.283082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.284010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.290252 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.294019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.294019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.294019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.321808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a5714345-8b6d-4ff6-a648-a2783d8db1b0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Jul 21 23:00:20.322366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 485/1009] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:20.574783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.575413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.581501 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.581954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.582725 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.583188 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.714109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:20.722741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d1d9ec98-bab9-4462-bcaf-f83757c3274d tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.151213 Jul 21 23:00:20.723346 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 525/1010] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:20.985457 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.985976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.992577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.993023 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.993800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.994229 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.169976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.171558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.177471 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.177919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.178685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.179309 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.208925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7f073511-54b0-403f-9a1b-968cbe4f8954 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 21 23:00:21.212819 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 526/1011] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:21.212988 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.221281 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.223479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.224646 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e2f0e68b-9018-462a-947f-09566b01d574 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.243175 Jul 21 23:00:21.225250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 486/1012] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:21.333796 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.334721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.340705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.341150 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.341906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.342340 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.371215 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d55e17da-7987-431b-8516-c5ff4a4b1bcc tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Jul 21 23:00:21.371929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 527/1013] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:21.524784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.524784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.529757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.530271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.531069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.532322 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.563353 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-93da2467-7e59-476d-919e-e7cd17945a54 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045610 Jul 21 23:00:21.563911 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 487/1014] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:21.714085 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.714567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.720467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.720906 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.723013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.723013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.739728 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.740436 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.746565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.747056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.747830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.748268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.751220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a02d86e2-8814-41e7-9983-ce452512adc6 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83" status: 200 len: 194 microversion: 2.1 time: 0.041108 Jul 21 23:00:21.755926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 528/1015] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:21.761463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.761943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.767783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.768229 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.769578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.770005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.773953 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=100 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:21.850333 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lazy-loading 'services' on Instance uuid f7af3cf9-8c87-41f9-a908-b12ca94202dd {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:21.884180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.891772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cea86711-011f-40d9-8383-af20a499c05f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1313 microversion: 2.1 time: 0.155947 Jul 21 23:00:21.892447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 488/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:22.046316 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-06a5e1a8-1de8-4a82-8f9c-9dfecc22361e tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83" status: 202 len: 0 microversion: 2.1 time: 0.288270 Jul 21 23:00:22.046945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 529/1017] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:00:21 2022] DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/1b074cca-09e6-4e53-a411-7273f65d2d83 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:00:22.220142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.221134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.228319 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.228770 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.229533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.230034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.244754 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.245520 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.251912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.252441 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.253291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.253718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.259846 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a4cfa3c5-1e5d-47c2-bab4-14772e99b6a2 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jul 21 23:00:22.260424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 489/1018] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:22.384619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:22.385563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.386669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.391674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:22.393016 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.393245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:22.393459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.394290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.394494 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ae5c4308-7996-433b-a5c4-20e89a705c8c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.154567 Jul 21 23:00:22.394753 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.395187 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 530/1019] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:00:22.424240 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6be953f8-87c8-4921-9d59-bc0fabbb805a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Jul 21 23:00:22.426900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 490/1020] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:22.910686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.916231 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.917716 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.918203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.919010 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.919448 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.117048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.126865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-827457e5-8b81-4634-b3d6-8de8b5fdc180 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1496 microversion: 2.1 time: 0.221921 Jul 21 23:00:23.129697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 531/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1496 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:23.272246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.273487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.286170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.286618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.287438 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.287870 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.333632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8a2cb964-2e55-4031-b9f3-d321957d47e1 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066054 Jul 21 23:00:23.346142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 491/1022] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:23.413681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.414273 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.420872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.421418 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.422252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.422742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.438301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.438301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.445165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.445609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.446684 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.447174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.473550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=100 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:23.478216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cc31245c-2cd1-465c-994f-f005e0d39d91 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045849 Jul 21 23:00:23.479025 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 492/1023] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 23:00:23.542449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.542976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.549512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.550518 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.551346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.551782 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.580695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:23.582161 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.591518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.593637 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.594863 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6e8026b6-11d1-4d86-aa52-9e6508c63a8e tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.186472 Jul 21 23:00:23.596350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 532/1024] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:23.797722 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:23.892658 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8841c829-7146-46dc-9511-4593f06453fb tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 204 len: 0 microversion: 2.1 time: 0.353771 Jul 21 23:00:23.893412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 493/1025] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:23 2022] DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:00:23.901616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.902227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.910292 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.910750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.912319 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.912765 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.055406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.059644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.060248 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.064044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5bb2643c-a957-46b7-86c4-d48382c86f6d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1682 microversion: 2.1 time: 0.166303 Jul 21 23:00:24.064731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 533/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:24.066864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.067320 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.068092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.068523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.096237 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:24.345644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.346627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.353375 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.353821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.354590 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.355178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.383608 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d430a368-7350-47a9-8c76-223a42ccac18 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042024 Jul 21 23:00:24.384173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 534/1027] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:24 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:24.427503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-edde90cf-6af0-4075-9e05-932531b59a58 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 204 len: 0 microversion: 2.1 time: 0.378305 Jul 21 23:00:24.428155 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 494/1028] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:24 2022] DELETE /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:00:24.436356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.437268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.444151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.444601 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.445364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.445804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.572755 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.580329 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8bcc7c6f-d5c3-463b-8e80-f789315453b6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1502 microversion: 2.1 time: 0.147849 Jul 21 23:00:24.580920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 535/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:24 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:24.613927 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.614619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.620800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.621243 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.621992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.622420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.748705 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.757122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.758624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.759793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-15e5d4ce-6067-41b7-984d-9f01531629bb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.150241 Jul 21 23:00:24.760347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 495/1030] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:24 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:25.082160 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:25.082782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:25.084794 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:25.089974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.090410 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.091277 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.091710 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.127148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-1a58b5ba-4d65-409b-9f9d-27122b034ecb req-deca7be5-cc7e-4577-a2d7-df4e67b017f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "name": "network-vif-plugged", "status": "completed", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:25.136641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1a58b5ba-4d65-409b-9f9d-27122b034ecb req-deca7be5-cc7e-4577-a2d7-df4e67b017f0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.137177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1a58b5ba-4d65-409b-9f9d-27122b034ecb req-deca7be5-cc7e-4577-a2d7-df4e67b017f0 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.150685 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-1a58b5ba-4d65-409b-9f9d-27122b034ecb req-deca7be5-cc7e-4577-a2d7-df4e67b017f0 service nova] Creating event network-vif-plugged:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 23:00:25.155974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-1a58b5ba-4d65-409b-9f9d-27122b034ecb req-deca7be5-cc7e-4577-a2d7-df4e67b017f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Jul 21 23:00:25.158336 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 496/1031] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:25.226720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.235620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7a17e8b9-40b8-4af7-be21-489cebfc9d78 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1682 microversion: 2.1 time: 0.158042 Jul 21 23:00:25.236350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 536/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:25 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:25.395256 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:25.396275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:25.402955 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.403408 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.404169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.404606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.433797 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b89d4bd6-30d9-40cc-bd2e-5ce97e5fcb93 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Jul 21 23:00:25.434657 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 497/1033] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:25 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:25.598479 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:25.599118 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:25.605985 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.606439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.610066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.610066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.738741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.746326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-811bf14a-2107-472a-bf04-5232e5566344 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1502 microversion: 2.1 time: 0.152742 Jul 21 23:00:25.746911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 537/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:25 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:25.777506 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:25.778059 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:25.784177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.785220 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.785987 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.786426 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.914636 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.922534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.924065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.925217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cb66d106-af13-4e74-8624-9f7dfcb0fb9d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.151775 Jul 21 23:00:25.925787 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 498/1035] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:25 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:26.254141 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.254746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.261094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.261540 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.262523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.262998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.390067 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:26.397465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ddf50226-abc9-42c9-b465-377f6a7b29a7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1682 microversion: 2.1 time: 0.147862 Jul 21 23:00:26.398031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 538/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:26.445994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.446961 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.453392 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.453841 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.454608 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.455069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.483207 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4d409d72-96ba-4370-a3c3-12f3e4c04a97 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041094 Jul 21 23:00:26.483767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 499/1037] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:00:26.494072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.494568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.500594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.501048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.501814 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.502251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.575046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] HTTP exception thrown: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 is not attached to volume 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Request method failure captured: Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments/0aeb9f1e-ac9e-4944-81a5-f4140399ab1d HTTP/1.1 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dnBckrC1MnKDMa2FqWW360WCo1RqdgKtHc44ujkEqUFzm1wB-G7_-Ece0ZaW-C893c-sHxU8wqLyVwRZ10lEodZ_mZ4Y7BtNgFD_XK7t-xDNk4VlDhCQFXdEHLc511uJBLTeqZpomM7WRytPJm-8OHzyJR-TuPEn1nsYUp_hS7fNgA Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 5dbf5236757941d6b4db3517e1757621 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:26.577383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5dbf5236757941d6b4db3517e1757621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 5dbf5236757941d6b4db3517e1757621 Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-TestMinimumBasicScenario-558931849-project Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 257adcc88884437eb740f78dbd9e19c2 Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-TestMinimumBasicScenario-558931849-project Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:26.579083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 is not attached to volume 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'server_id': 'a4af0c74-4e0a-4b83-abb6-bdf7216abe88', 'id': '0aeb9f1e-ac9e-4944-81a5-f4140399ab1d'} Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d. Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:26.579948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 is not attached to volume 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 is not attached to volume 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:26.581435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Returning 404 to user: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 is not attached to volume 0aeb9f1e-ac9e-4944-81a5-f4140399ab1d {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:26.582581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3ae13263-f81d-4237-b779-f3ea44df17bb tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments/0aeb9f1e-ac9e-4944-81a5-f4140399ab1d" status: 404 len: 154 microversion: 2.1 time: 0.088815 Jul 21 23:00:26.582581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 539/1038] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:00:26 2022] DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88/os-volume_attachments/0aeb9f1e-ac9e-4944-81a5-f4140399ab1d => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:26.763461 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.764296 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.770244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.778063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.778063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.778063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.904086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:26.912068 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-be75ae63-cd9d-4b2d-9b8b-4d763175c4a1 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1502 microversion: 2.1 time: 0.152427 Jul 21 23:00:26.912640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 500/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:26.942527 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.943179 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.950065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.950663 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.951455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.951885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.090439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:27.100213 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:27.101802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:27.103373 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-98785226-4327-4bc2-b594-667194b46be7 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.164681 Jul 21 23:00:27.103874 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 540/1040] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:27.415300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:27.415918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:27.422645 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.428271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.428271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.428271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.569227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:27.584102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5f2328e8-21f6-4fec-8fe8-5e684555c169 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1682 microversion: 2.1 time: 0.172658 Jul 21 23:00:27.585002 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 501/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:27 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:27.936930 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:27.937856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:27.945036 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.946186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.947000 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.947631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.029948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.030938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.037071 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.037992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.038666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.039393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.069488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:28.205251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.214081 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-6939ad8f-f5c6-4d44-be70-d6b8ea34998a tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1502 microversion: 2.1 time: 0.281091 Jul 21 23:00:28.218845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 541/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:27 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:28.221290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.222900 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.231914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.233195 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.234391 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.234510 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.408147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.420551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.422297 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.423805 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ca132164-71b7-4fa8-82bc-e2e7b5d42eb4 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.208208 Jul 21 23:00:28.425578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 542/1043] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:28 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:28.431789 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-7b0469ef-68f8-45e0-9dd2-20523f412c76 req-9777d997-fb29-4284-b28e-78b6533237ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ceb58b-5c05-426a-be36-7ea89f4ac6a6", "name": "network-vif-deleted", "tag": "96d520a8-b232-41e7-8da8-0ec35d964762"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:28.439551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-278ef12f-b730-4fda-afe2-fe20ce4f73d6 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 204 len: 0 microversion: 2.1 time: 0.413388 Jul 21 23:00:28.440272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 502/1044] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:28 2022] DELETE /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:00:28.446002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-7b0469ef-68f8-45e0-9dd2-20523f412c76 req-9777d997-fb29-4284-b28e-78b6533237ff service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.446668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-7b0469ef-68f8-45e0-9dd2-20523f412c76 req-9777d997-fb29-4284-b28e-78b6533237ff service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.448134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-b23ccf97-ffc7-4606-8e70-37da919807a5 req-371681be-aa89-498a-b242-de8c0566f278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fff0c7-83f1-445a-b6e0-32d1f5831ecb", "name": "network-vif-deleted", "tag": "31ffe9d2-f878-4725-811a-0c9011087597"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:28.463221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-7b0469ef-68f8-45e0-9dd2-20523f412c76 req-9777d997-fb29-4284-b28e-78b6533237ff service nova] Creating event network-vif-deleted:96d520a8-b232-41e7-8da8-0ec35d964762 for instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 on hv-cinder-85069 Jul 21 23:00:28.468450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-7b0469ef-68f8-45e0-9dd2-20523f412c76 req-9777d997-fb29-4284-b28e-78b6533237ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041272 Jul 21 23:00:28.469396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 543/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:28.475841 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.476674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.482541 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-b23ccf97-ffc7-4606-8e70-37da919807a5 req-371681be-aa89-498a-b242-de8c0566f278 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.483029 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-b23ccf97-ffc7-4606-8e70-37da919807a5 req-371681be-aa89-498a-b242-de8c0566f278 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.484442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.484976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.485972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.486480 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.497118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-b23ccf97-ffc7-4606-8e70-37da919807a5 req-371681be-aa89-498a-b242-de8c0566f278 service nova] Creating event network-vif-deleted:31ffe9d2-f878-4725-811a-0c9011087597 for instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb on hv-cinder-85069 Jul 21 23:00:28.503767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-b23ccf97-ffc7-4606-8e70-37da919807a5 req-371681be-aa89-498a-b242-de8c0566f278 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061990 Jul 21 23:00:28.507759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 503/1046] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:28.513547 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.514249 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.520683 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.521420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.522273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.522864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.555983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cc7cc7bc-64c2-457e-86df-a466ffe063ad tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/2598ef79-7ff0-4f0d-9e34-8707f6a34913" status: 200 len: 194 microversion: 2.1 time: 0.047830 Jul 21 23:00:28.556693 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 504/1047] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Jul 21 23:00:28 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/2598ef79-7ff0-4f0d-9e34-8707f6a34913 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:28.566505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.567318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.574004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.576615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.576615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.576615 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.632723 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.640390 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-af43cfb2-ff9b-4ad1-b6f2-4ef79133508e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1556 microversion: 2.1 time: 0.169330 Jul 21 23:00:28.641060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 544/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:28 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:28.646308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.646929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.652823 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.653271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.654034 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.654468 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.674373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:28.677947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lazy-loading 'services' on Instance uuid f7af3cf9-8c87-41f9-a908-b12ca94202dd {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:28.724565 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.727035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:28.733719 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5a822983-c1ba-412e-9b78-0631fdb5265d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1327 microversion: 2.1 time: 0.091405 Jul 21 23:00:28.736903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 545/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:28 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:28.903940 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3c299578-8463-470c-a76e-5d5947e0570b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/2598ef79-7ff0-4f0d-9e34-8707f6a34913" status: 202 len: 0 microversion: 2.1 time: 0.341212 Jul 21 23:00:28.904530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 505/1050] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:00:28 2022] DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments/2598ef79-7ff0-4f0d-9e34-8707f6a34913 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:00:29.232128 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.233224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.240221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.240671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.241480 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.241921 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.276594 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.277115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.277625 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lazy-loading 'fault' on Instance uuid b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:29.320738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.329178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1e8bf165-6206-402a-9b16-75f3687e9ca8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1303 microversion: 2.1 time: 0.101020 Jul 21 23:00:29.329762 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 546/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:29.447597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.448369 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.456968 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.457746 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.458684 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.459327 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.596289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.604560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.606072 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.607259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9888c77e-a151-4fc5-8476-27157a2debf0 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1729 microversion: 2.20 time: 0.165438 Jul 21 23:00:29.607822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 506/1052] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:29.657401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.658014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.663999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.664444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.665216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.665652 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.751814 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.752425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.758647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.759139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.759910 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.760485 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.827046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.835501 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-72685ba6-77e2-49a5-acf7-396295c7fce3 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1327 microversion: 2.1 time: 0.088300 Jul 21 23:00:29.836089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 507/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:30.059682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.067713 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-97c66312-cc63-4955-b1b0-ca551501182e tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1556 microversion: 2.1 time: 0.414185 Jul 21 23:00:30.068283 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 547/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1556 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:30.348486 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:30.349138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:30.356922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.357646 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.358332 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.358788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.390764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.391242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.391689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lazy-loading 'fault' on Instance uuid b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:30.433975 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.442550 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c29cf715-f1a1-4a3f-9ba3-6abaae4925d8 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1303 microversion: 2.1 time: 0.098630 Jul 21 23:00:30.443165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 508/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:30 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:30.625635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:30.626184 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:30.632845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.633287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.634032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.634463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.761536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.769498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.771022 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.772163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d76bf956-d009-4cb7-bfa0-e4102fbc4c4f tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1716 microversion: 2.20 time: 0.150627 Jul 21 23:00:30.772718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 548/1056] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:00:30 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:00:30.854595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:30.857789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:30.861671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.862121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.862983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.863420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.896594 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.896972 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.897419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'fault' on Instance uuid 35fff0c7-83f1-445a-b6e0-32d1f5831ecb {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:30.940300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.947698 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c85e6131-7c6e-4d7f-aede-f374a170551a tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 200 len: 1332 microversion: 2.1 time: 0.097449 Jul 21 23:00:30.949479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 509/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:30 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:31.085537 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:31.086144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:31.092118 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.092568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.093324 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.093759 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.224341 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:31.232090 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-87e6ef8b-1655-4254-ae63-780d06048caf tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1556 microversion: 2.1 time: 0.150979 Jul 21 23:00:31.232659 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 549/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:31 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:31.462668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:31.463321 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:31.470969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.471421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.472202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.472632 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.506164 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.506612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.507088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lazy-loading 'fault' on Instance uuid b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:31.551088 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:31.559983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-155396b9-95e0-4535-a189-e009cb2a1b56 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 200 len: 1303 microversion: 2.1 time: 0.103621 Jul 21 23:00:31.560760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 510/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:31 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:31.747730 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-199ed3eb-03fb-49ff-b270-47a18af5960e req-c3dcded3-30e4-4c01-8dad-5e20a5d3a443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4af0c74-4e0a-4b83-abb6-bdf7216abe88", "name": "network-vif-deleted", "tag": "f2c971ef-1e12-4937-8388-d94ceee5e560"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:31.756990 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-199ed3eb-03fb-49ff-b270-47a18af5960e req-c3dcded3-30e4-4c01-8dad-5e20a5d3a443 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.757436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-199ed3eb-03fb-49ff-b270-47a18af5960e req-c3dcded3-30e4-4c01-8dad-5e20a5d3a443 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.768576 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-199ed3eb-03fb-49ff-b270-47a18af5960e req-c3dcded3-30e4-4c01-8dad-5e20a5d3a443 service nova] Creating event network-vif-deleted:f2c971ef-1e12-4937-8388-d94ceee5e560 for instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 on hv-cinder-85069 Jul 21 23:00:31.774278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-199ed3eb-03fb-49ff-b270-47a18af5960e req-c3dcded3-30e4-4c01-8dad-5e20a5d3a443 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029930 Jul 21 23:00:31.774881 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 550/1060] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:31.965578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:31.966140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:31.973145 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.973602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.974382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.974874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.989422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb HTTP/1.1 Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:00:31.991203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:00:31.992754 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '35fff0c7-83f1-445a-b6e0-32d1f5831ecb'} Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:31.993759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:00:31.995823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:31.997767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:31.997767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b82fa63c-8ec8-4d19-bf9d-148586dde31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 404 len: 111 microversion: 2.1 time: 0.031245 Jul 21 23:00:31.997767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 511/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:31 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:32.001815 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7402c6da-583f-42b6-81f9-a3b3d3c2ed74 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '.version_select at 0x7fc5d7fdf550>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.078384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7402c6da-583f-42b6-81f9-a3b3d3c2ed74 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559530401" status: 202 len: 0 microversion: 2.1 time: 0.079961 Jul 21 23:00:32.079314 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 551/1062] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 21 23:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559530401 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:00:32.187983 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.189300 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.195731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.196190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.197031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.197611 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.228054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c620ed8e-39db-48bb-96dd-0b18f9bc2eed tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044531 Jul 21 23:00:32.228551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 512/1063] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:00:32.249002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.249943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.257068 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.257528 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.258348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.258807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.291328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.291779 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.292233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lazy-loading 'fault' on Instance uuid a4af0c74-4e0a-4b83-abb6-bdf7216abe88 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:32.341949 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.342943 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.347515 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257adcc88884437eb740f78dbd9e19c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbf5236757941d6b4db3517e1757621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:32.349199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.349827 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.351092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.351744 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.360907 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-65146f93-10f9-49f7-a086-b619e5f8ca36 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 200 len: 1349 microversion: 2.1 time: 0.115733 Jul 21 23:00:32.361753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 552/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:32.386765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8ac64921-d6a8-480d-8dbb-d52251a76dea tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048798 Jul 21 23:00:32.387441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 513/1065] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 23:00:32.458343 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.458893 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.464943 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.465460 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.466233 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.466681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.498415 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:32.578527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.579557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: b4ceb58b-5c05-426a-be36-7ea89f4ac6a6] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.590424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.590424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.590424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.590424 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.602591 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] HTTP exception thrown: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Request method failure captured: Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 HTTP/1.1 Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dptJ7H170358S8Zb3aBuWHb8oeKL_M00xxq_lMz5oz_1597upRTfXCM7LbJMN-yxilunVK7D2dXXzQQXcyMrTA4IB0iYGEq7D-D2DIujx91CYsUnWZ88M-OgySRJR6_oUogY6OPegZcS2Qhgxku0OdMIF0gMuMbE2GfnaW-9vmrbas Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 3429139a6e494a7290d91dd3cb8f712c Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesActionsTest-1775839 Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:00:32.604647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3429139a6e494a7290d91dd3cb8f712c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesActionsTest-1775839 Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 3429139a6e494a7290d91dd3cb8f712c Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesActionsTest-1775839 Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesActionsTest-1775839-project Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 932c6d0ae774493a852781e4c8d83e67 Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesActionsTest-1775839-project Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. Jul 21 23:00:32.606097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'b4ceb58b-5c05-426a-be36-7ea89f4ac6a6'} Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:32.607091 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. Jul 21 23:00:32.608454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:32.609751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Returning 404 to user: Instance b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:32.609751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-30a35167-96ee-4344-a9dd-536313708a94 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6" status: 404 len: 111 microversion: 2.1 time: 0.032150 Jul 21 23:00:32.610008 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 514/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/b4ceb58b-5c05-426a-be36-7ea89f4ac6a6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:00:32.666340 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1945247702", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "networks": [{"uuid": "818409ac-b84e-41b9-a0f7-dd64c062b10f"}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:32.723533 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] validate_networks() for [('818409ac-b84e-41b9-a0f7-dd64c062b10f', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:00:32.793451 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1b90ae93-a80d-46b5-9665-e14548d90e3f tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 204 len: 0 microversion: 2.1 time: 0.338653 Jul 21 23:00:32.794007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 553/1067] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:32 2022] DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:00:32.805086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.805851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.812351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.812788 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.813549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.814024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.950747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:32.959116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9a5e40f8-7c05-465a-aea7-800fa85566db tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1673 microversion: 2.1 time: 0.160776 Jul 21 23:00:32.959839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 554/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:33.063935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-389ea538-4ff4-44be-8479-426e568c67da tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: .version_select at 0x7fc5d75f33a0>, body: {"keypair": {"name": "tempest-keypair-1807641836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuTElEtNtJkUCBfVayq+u7CVJAjXonWquexFn0Yt7wWaD7fU18M6azJTWt9qQZ4fqhK48sdnxIgrZ94glaRcQkUQK+sGg8xsH2UYazZ0qG26IYLbul4fc8qFQThzY281g=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:33.077638 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-389ea538-4ff4-44be-8479-426e568c67da tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:00:33.081795 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-389ea538-4ff4-44be-8479-426e568c67da tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:00:33.163202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:00:33.163639 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:00:33.164075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:00:33.164514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:00:33.164935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:00:33.166869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-389ea538-4ff4-44be-8479-426e568c67da tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105984 Jul 21 23:00:33.166869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 555/1069] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 23:00:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:33.174627 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.175142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.175939 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.176376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.193938 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Getting quotas for project 3429139a6e494a7290d91dd3cb8f712c. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:00:33.198034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Getting quotas for user 932c6d0ae774493a852781e4c8d83e67 and project 3429139a6e494a7290d91dd3cb8f712c. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:00:33.209525 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:00:33.211820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:00:33.381683 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:33.382322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] [instance: a4af0c74-4e0a-4b83-abb6-bdf7216abe88] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:33.388283 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.388731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.389500 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.389935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.403968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] HTTP exception thrown: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Request method failure captured: Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 HTTP/1.1 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dnBckrC1MnKDMa2FqWW360WCo1RqdgKtHc44ujkEqUFzm1wB-G7_-Ece0ZaW-C893c-sHxU8wqLyVwRZ10lEodZ_mZ4Y7BtNgFD_XK7t-xDNk4VlDhCQFXdEHLc511uJBLTeqZpomM7WRytPJm-8OHzyJR-TuPEn1nsYUp_hS7fNgA Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 5dbf5236757941d6b4db3517e1757621 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:33.405620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5dbf5236757941d6b4db3517e1757621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5dbf5236757941d6b4db3517e1757621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 5dbf5236757941d6b4db3517e1757621 Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558931849 Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-TestMinimumBasicScenario-558931849-project Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 257adcc88884437eb740f78dbd9e19c2 Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-TestMinimumBasicScenario-558931849-project Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. Jul 21 23:00:33.410054 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'a4af0c74-4e0a-4b83-abb6-bdf7216abe88'} Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:33.412098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. Jul 21 23:00:33.413335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:33.416885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Returning 404 to user: Instance a4af0c74-4e0a-4b83-abb6-bdf7216abe88 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:33.416885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-30c4baf7-ee7f-453f-b044-c402a5b6e1d8 tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88" status: 404 len: 111 microversion: 2.1 time: 0.029509 Jul 21 23:00:33.416885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 556/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:33 2022] GET /compute/v2.1/servers/a4af0c74-4e0a-4b83-abb6-bdf7216abe88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:33.416885 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fe4c9bd6-4fb1-4b8d-9fb1-7db66a1bce3a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] Calling method '.version_select at 0x7fc5d730f940>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:33.429039 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-141fd8f1-b6e2-4527-b3d3-f89cef9e4fa6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766572 Jul 21 23:00:33.429723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 515/1071] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 23:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 23:00:33.439558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d31f0578-99ba-48b5-bca5-ca8956dea171 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:33.440159 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d31f0578-99ba-48b5-bca5-ca8956dea171 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:33.503695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d31f0578-99ba-48b5-bca5-ca8956dea171 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:33.511946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d31f0578-99ba-48b5-bca5-ca8956dea171 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1214 microversion: 2.1 time: 0.076182 Jul 21 23:00:33.512774 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 516/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:33 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:33.530636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fe4c9bd6-4fb1-4b8d-9fb1-7db66a1bce3a tempest-TestMinimumBasicScenario-558931849 tempest-TestMinimumBasicScenario-558931849-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1619366543" status: 202 len: 0 microversion: 2.1 time: 0.116650 Jul 21 23:00:33.530636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 557/1073] 10.222.0.52 () {58 vars in 1271 bytes} [Thu Jul 21 23:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1619366543 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:00:33.976314 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:33.976926 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:33.983932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.984395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.985178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.985620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.399465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:34.407712 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bb07e19f-ee5f-4419-90b5-1acb8d933120 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1673 microversion: 2.1 time: 0.435273 Jul 21 23:00:34.408284 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 517/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:33 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1673 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:34.530003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:34.530704 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:34.548662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.549110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.552118 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.552118 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.624620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:34.632056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f8f73612-a3e3-416d-9828-a5956d8db8a6 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1218 microversion: 2.1 time: 0.106118 Jul 21 23:00:34.632634 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 558/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:34 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:35.427203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:35.428602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:35.436789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.437478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.438345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.439175 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.650142 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:35.650832 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:35.659348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.659848 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.660658 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.661689 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.744299 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:35.752323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e577cf9d-7ea0-4abf-94e1-2dc8e9e092cb tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1673 microversion: 2.1 time: 0.330497 Jul 21 23:00:35.762373 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 518/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:35 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1673 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:35.795721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:35.803934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1222b9c6-5d0c-45c0-b824-c4f0b1d67449 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1274 microversion: 2.1 time: 0.158533 Jul 21 23:00:35.804514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 559/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:35 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:35.939634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2075539126", "imageRef": "990b97e2-c51a-4911-915b-b0252472462e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be9945ce-a7e9-414b-b532-8c7c706d9d8c"}], "security_groups": [{"name": "tempest-securitygroup--1942148616"}], "key_name": "tempest-keypair-1807641836", "user_data": "}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:36.141089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-3e5b842a-5c7a-4003-a36d-9b21c0ac64a1 req-454fe7d6-e25d-4f3e-ae05-712a2856d9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7af3cf9-8c87-41f9-a908-b12ca94202dd", "name": "network-vif-deleted", "tag": "18c604d0-57b0-45a4-a124-d78abd64bf0c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:36.150100 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] validate_networks() for [('be9945ce-a7e9-414b-b532-8c7c706d9d8c', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:00:36.170111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-3e5b842a-5c7a-4003-a36d-9b21c0ac64a1 req-454fe7d6-e25d-4f3e-ae05-712a2856d9e2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.170568 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-3e5b842a-5c7a-4003-a36d-9b21c0ac64a1 req-454fe7d6-e25d-4f3e-ae05-712a2856d9e2 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.183911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-3e5b842a-5c7a-4003-a36d-9b21c0ac64a1 req-454fe7d6-e25d-4f3e-ae05-712a2856d9e2 service nova] Creating event network-vif-deleted:18c604d0-57b0-45a4-a124-d78abd64bf0c for instance f7af3cf9-8c87-41f9-a908-b12ca94202dd on hv-cinder-85069 Jul 21 23:00:36.189554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-3e5b842a-5c7a-4003-a36d-9b21c0ac64a1 req-454fe7d6-e25d-4f3e-ae05-712a2856d9e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052347 Jul 21 23:00:36.190757 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 560/1078] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:36.775155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:36.778252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:36.791746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.792423 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.799582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.799582 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.830003 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:00:36.833904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:00:36.833904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:00:36.833904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:00:36.833904 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:00:36.848819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.850469 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.852106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.854184 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.858356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.859420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.860381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lazy-loading 'fault' on Instance uuid f7af3cf9-8c87-41f9-a908-b12ca94202dd {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:36.901105 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:00:36.906033 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Getting quotas for user 8c11dc2f4c764dc58458d9226efc878e and project 224678a5f1db4416b8175d315a4e4a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:00:36.925406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:00:36.928422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='990b97e2-c51a-4911-915b-b0252472462e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:00:36.939496 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9ff560b7044ea2a18b3c3f8295937e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08576395a1f1437385d2f24b482572a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:36.943227 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:36.949898 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f02cc200-2dbf-460e-9e65-7f9b5cfecb1b tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 200 len: 1328 microversion: 2.1 time: 0.182927 Jul 21 23:00:36.951736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 561/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:36 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 1328 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:36.956436 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:36.957222 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:36.964065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.964532 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.965936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.966246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.148537 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7ffb1c99-ab08-4f04-81e1-2ffb7a9c06b7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.213268 Jul 21 23:00:37.150042 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 519/1080] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 23:00:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 23:00:37.161669 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b4adf2eb-a1bd-417a-ae3d-5efe2c3a3321 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:37.167718 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b4adf2eb-a1bd-417a-ae3d-5efe2c3a3321 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:37.235895 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:37.246175 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f31ca49c-8a45-486b-95c6-7d6916f29baf tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.293329 Jul 21 23:00:37.251309 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 562/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:36 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:37.467454 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b4adf2eb-a1bd-417a-ae3d-5efe2c3a3321 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:37.504875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b4adf2eb-a1bd-417a-ae3d-5efe2c3a3321 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1242 microversion: 2.1 time: 0.344306 Jul 21 23:00:37.507516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 520/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:37 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1242 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:37.967790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:37.969035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:37.977000 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.980437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.980437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.980437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.994403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd HTTP/1.1 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:37.996574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:37.998134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'f7af3cf9-8c87-41f9-a908-b12ca94202dd'} Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:37.999093 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:38.000317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:38.002330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:38.003384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cff67573-781d-4bf5-aa0c-29c5926520a5 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 404 len: 111 microversion: 2.1 time: 0.039458 Jul 21 23:00:38.004579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 563/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:37 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:00:38.013170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-69ec8a62-6509-479e-8a5e-b056f2b1dec1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '.version_select at 0x7fc5e4550ca0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:38.090448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-69ec8a62-6509-479e-8a5e-b056f2b1dec1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866407849" status: 202 len: 0 microversion: 2.1 time: 0.081222 Jul 21 23:00:38.095250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 521/1084] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 21 23:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866407849 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:00:38.271382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:38.272083 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:38.278545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.279115 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.279956 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.280461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.447714 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-1751e627-7fd2-43be-a468-5cb777952e31 req-3e04faf7-8764-4a1d-8a03-79495ff0623c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d980f3d9-4df6-4d77-b5cc-033b2fba11b5", "tag": "23a25184-d321-4db9-a3b9-3076cbe96a63"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:38.458224 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1751e627-7fd2-43be-a468-5cb777952e31 req-3e04faf7-8764-4a1d-8a03-79495ff0623c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.458956 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-1751e627-7fd2-43be-a468-5cb777952e31 req-3e04faf7-8764-4a1d-8a03-79495ff0623c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.472065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:38.480383 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-1751e627-7fd2-43be-a468-5cb777952e31 req-3e04faf7-8764-4a1d-8a03-79495ff0623c service nova] Creating event network-changed:23a25184-d321-4db9-a3b9-3076cbe96a63 for instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 on hv-cinder-85069 Jul 21 23:00:38.483121 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-40c7cb18-6f86-4e88-bafd-e0b10d4c23ca tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.216093 Jul 21 23:00:38.487837 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-1751e627-7fd2-43be-a468-5cb777952e31 req-3e04faf7-8764-4a1d-8a03-79495ff0623c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043648 Jul 21 23:00:38.490307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 522/1085] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:00:38.499364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 564/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:38 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:38.525806 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:38.528509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:38.536095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.536095 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.537308 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.537743 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.940959 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:38.948616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8c7fac6f-0a43-48da-812b-899b00c69484 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1238 microversion: 2.1 time: 0.429165 Jul 21 23:00:38.949188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 523/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:38 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1238 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:39.501349 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:39.502512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:39.518293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.520348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.531560 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.538383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.584214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:39.894927 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:39.904253 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1b01f36e-dcc3-456e-83ff-674d808d5e5f tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.408267 Jul 21 23:00:39.905136 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 565/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:39 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:39.965937 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:39.967409 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:39.975789 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.976412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.976918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.977171 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:40.126170 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:40.134887 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b193184f-c158-4c73-9c83-3674b4b0c919 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1300 microversion: 2.1 time: 0.173183 Jul 21 23:00:40.136199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 524/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:39 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:40.922453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:40.923761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:40.935733 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:40.936481 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:40.939387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:40.939387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.153565 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:41.154288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:41.161721 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.163064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.163064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.163450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.291295 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:41.300631 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4836bd1e-2116-4cb3-bfc4-049c577e478c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.382411 Jul 21 23:00:41.301299 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 566/1090] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:40 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:41.664484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:41.672003 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:41.672607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5e7c4022-1b92-42c8-adb0-51a98350319e tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.523586 Jul 21 23:00:41.673098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:41.673597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 525/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:41 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:41.683473 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.684238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.685062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-d6079ddb-9778-4411-992d-75b1a2469353 req-ac914bc0-3f98-4a5d-8b2b-e90016369dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:41.685442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.686326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.696419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-d6079ddb-9778-4411-992d-75b1a2469353 req-ac914bc0-3f98-4a5d-8b2b-e90016369dfe service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.697631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-d6079ddb-9778-4411-992d-75b1a2469353 req-ac914bc0-3f98-4a5d-8b2b-e90016369dfe service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.713779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-d6079ddb-9778-4411-992d-75b1a2469353 req-ac914bc0-3f98-4a5d-8b2b-e90016369dfe service nova] Creating event network-changed:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 23:00:41.720746 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:41.724403 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-d6079ddb-9778-4411-992d-75b1a2469353 req-ac914bc0-3f98-4a5d-8b2b-e90016369dfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049441 Jul 21 23:00:41.725519 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 526/1092] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:42.164008 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b653ed6f-abe5-4b09-b001-def9a752c135 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 204 len: 0 microversion: 2.1 time: 0.487263 Jul 21 23:00:42.165048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 567/1093] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:41 2022] DELETE /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:00:42.174114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:42.175474 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:42.187920 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.188379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.189487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.190153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.318620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:42.319344 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:42.331262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.332147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.337892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.337892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.338131 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:42.339566 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:42.345304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2a2678ab-7d56-40bf-9710-54e1556ed95e tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.174993 Jul 21 23:00:42.346326 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 527/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:42 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:42.517034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-f1438651-4e51-43d2-a7b4-af57061b4609 req-4768fdbf-1cd4-4cc9-aebd-39919917ba74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5bc4f7-fb78-4187-86f7-c1968da77fd8", "tag": "f68facab-85d2-4dce-b7fe-29d6be7adca1"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:42.533059 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-f1438651-4e51-43d2-a7b4-af57061b4609 req-4768fdbf-1cd4-4cc9-aebd-39919917ba74 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.533602 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-f1438651-4e51-43d2-a7b4-af57061b4609 req-4768fdbf-1cd4-4cc9-aebd-39919917ba74 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.553745 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-f1438651-4e51-43d2-a7b4-af57061b4609 req-4768fdbf-1cd4-4cc9-aebd-39919917ba74 service nova] Creating event network-changed:f68facab-85d2-4dce-b7fe-29d6be7adca1 for instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 on hv-cinder-85069 Jul 21 23:00:42.572480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-f1438651-4e51-43d2-a7b4-af57061b4609 req-4768fdbf-1cd4-4cc9-aebd-39919917ba74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057933 Jul 21 23:00:42.573782 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 528/1095] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:42.659224 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:42.671685 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8ab21dea-addf-488d-b7cd-72bb85a91927 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.357656 Jul 21 23:00:42.672302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 568/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:42 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:42.691563 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:42.695703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:42.700382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.701191 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.702337 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.703070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.865823 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:42.873922 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-aefef1fb-36c8-44a0-a11a-507c6a2079c7 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.187210 Jul 21 23:00:42.874509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 529/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:42 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:43.002857 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.003363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.010130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.010581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.012022 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.012469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.035289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd HTTP/1.1 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:43.038424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.040246 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'f7af3cf9-8c87-41f9-a908-b12ca94202dd'} Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:43.041138 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.042511 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.044651 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:43.045519 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ea1b3b7-0e03-4caf-83ca-2f8592adc088 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 404 len: 111 microversion: 2.1 time: 0.046650 Jul 21 23:00:43.046109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 569/1098] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:42 2022] DELETE /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:00:43.056620 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.057576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: f7af3cf9-8c87-41f9-a908-b12ca94202dd] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.068596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.069081 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.073614 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.074127 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.091273 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd HTTP/1.1 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:00:43.094020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.095355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'f7af3cf9-8c87-41f9-a908-b12ca94202dd'} Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:43.096122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. Jul 21 23:00:43.097393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:43.099724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance f7af3cf9-8c87-41f9-a908-b12ca94202dd could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:43.099724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1b2a9bcb-7349-41ff-9096-f76afb7992b1 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd" status: 404 len: 111 microversion: 2.1 time: 0.044963 Jul 21 23:00:43.101307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 530/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/f7af3cf9-8c87-41f9-a908-b12ca94202dd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:43.365569 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.368336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.372060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=4 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:43.374750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:43.388955 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.395055 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.396704 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.397731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.689816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.690624 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.706190 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.710103 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.712597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.713234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.765821 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:43.777476 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-945d9b72-121f-4c1d-b561-56b580350e15 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1567 microversion: 2.1 time: 0.416488 Jul 21 23:00:43.781289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 570/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:43.891617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.892378 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.900009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.900556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.901411 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.902078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.950148 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:43.960790 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-4242f117-375c-4080-81a6-9244b6b921ef tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.274837 Jul 21 23:00:43.961458 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 531/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:44.374531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:44.384446 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-23c7f7eb-e808-4e14-8fa7-73f711a32ee2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.496743 Jul 21 23:00:44.385035 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 571/1102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:44.415362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-c9106bb3-8acb-4d22-9dc0-1f2580867566 req-037a673e-f1f9-4e74-b139-26ba2151d2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714e3636-339b-4d42-89b1-e3a5a6736c71", "name": "network-vif-deleted", "tag": "5537f61f-aefa-458c-a1a7-50dc97eca904"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:44.423425 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c9106bb3-8acb-4d22-9dc0-1f2580867566 req-037a673e-f1f9-4e74-b139-26ba2151d2ef service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.426469 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c9106bb3-8acb-4d22-9dc0-1f2580867566 req-037a673e-f1f9-4e74-b139-26ba2151d2ef service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.435560 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-c9106bb3-8acb-4d22-9dc0-1f2580867566 req-037a673e-f1f9-4e74-b139-26ba2151d2ef service nova] Creating event network-vif-deleted:5537f61f-aefa-458c-a1a7-50dc97eca904 for instance 714e3636-339b-4d42-89b1-e3a5a6736c71 on hv-cinder-85069 Jul 21 23:00:44.441114 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-c9106bb3-8acb-4d22-9dc0-1f2580867566 req-037a673e-f1f9-4e74-b139-26ba2151d2ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028960 Jul 21 23:00:44.441711 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 532/1103] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:44.481060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.483925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.488209 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.488656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.489457 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.489890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.505749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 HTTP/1.1 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:44.507403 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.514380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '9b3363b2-6211-444c-8595-b3a40ce92109'} Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:44.515171 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.516358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.517618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:44.517618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-340c5555-cc23-4338-881d-616de97c87ee tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 404 len: 111 microversion: 2.1 time: 0.032430 Jul 21 23:00:44.517618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 572/1104] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:44 2022] DELETE /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:44.524589 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.525342 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] [instance: 9b3363b2-6211-444c-8595-b3a40ce92109] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.536574 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.537497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.538453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.539146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.555969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] HTTP exception thrown: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Request method failure captured: Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 HTTP/1.1 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djn14dQ7vwJFlDeH8pEaA6j_YUydfxPjUOWn5iPxc_VDpLPgaPbFqRFtROGzv3l2NijjLvRZ5IMBVcy1M_XUSFUU_-0WP7Br_UCRq6QTaSP2Ft_tFJpvq1DvQNbq0v8tZg3ax3Jjv5irazdTMXcE2Lf8VrQqtd9xsi9LrWHE26IQbA Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:00:44.557634 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08576395a1f1437385d2f24b482572a6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08576395a1f1437385d2f24b482572a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08576395a1f1437385d2f24b482572a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 08576395a1f1437385d2f24b482572a6 Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-863176616 Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ef9ff560b7044ea2a18b3c3f8295937e Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeTestJSON-863176616-project Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.559635 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '9b3363b2-6211-444c-8595-b3a40ce92109'} Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:44.560732 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. Jul 21 23:00:44.562007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:44.563659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] Returning 404 to user: Instance 9b3363b2-6211-444c-8595-b3a40ce92109 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:44.563659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7e2c5ed7-70d5-48d6-a0e3-fa1309b65012 tempest-AttachVolumeTestJSON-863176616 tempest-AttachVolumeTestJSON-863176616-project] 10.222.0.52 "GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109" status: 404 len: 111 microversion: 2.1 time: 0.044323 Jul 21 23:00:44.563659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 533/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:44 2022] GET /compute/v2.1/servers/9b3363b2-6211-444c-8595-b3a40ce92109 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:44.801266 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.802636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.814236 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.815284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.816072 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.819636 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.975469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:44.983757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.984369 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.992914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d30bec77-c34a-4e68-9f3a-150edc85847a tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1219 microversion: 2.1 time: 0.195720 Jul 21 23:00:45.005613 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.006081 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.006909 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.007364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.009945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 573/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:44 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:45.358330 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-49b91e10-bb1e-4512-b29e-afc2c129c860 req-111a2739-1c37-462b-b898-02a992312e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d980f3d9-4df6-4d77-b5cc-033b2fba11b5", "name": "network-vif-plugged", "status": "completed", "tag": "23a25184-d321-4db9-a3b9-3076cbe96a63"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:45.372393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:45.381074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-49b91e10-bb1e-4512-b29e-afc2c129c860 req-111a2739-1c37-462b-b898-02a992312e02 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.384062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5c18cb13-1aad-4f47-a385-df6a3a057b0b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.404038 Jul 21 23:00:45.385860 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 534/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:44 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:45.396355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-49b91e10-bb1e-4512-b29e-afc2c129c860 req-111a2739-1c37-462b-b898-02a992312e02 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.408209 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:45.408831 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:45.424089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.424741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.431172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-49b91e10-bb1e-4512-b29e-afc2c129c860 req-111a2739-1c37-462b-b898-02a992312e02 service nova] Creating event network-vif-plugged:23a25184-d321-4db9-a3b9-3076cbe96a63 for instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 on hv-cinder-85069 Jul 21 23:00:45.432061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.432684 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.437771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-49b91e10-bb1e-4512-b29e-afc2c129c860 req-111a2739-1c37-462b-b898-02a992312e02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082894 Jul 21 23:00:45.438842 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 574/1108] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:45.678812 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:45.686609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7b723075-38c3-466d-b78c-5c8e3b20aa3c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.288582 Jul 21 23:00:45.692557 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 535/1109] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:45 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:46.010361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:46.011092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:46.028694 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.029547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.030604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.031287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.112315 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a765202a9645a1acc332f559537458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d60e3f3bcd48f292f30a8d2f0351d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:46.124087 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d5bf2235-2278-404c-b948-36125b52be43 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 200 len: 1219 microversion: 2.1 time: 0.118130 Jul 21 23:00:46.135120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 575/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:46 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:46.402453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:46.403065 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:46.409740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.410455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.411307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.411731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.704227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:46.704949 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:46.711852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.712428 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.713547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.714068 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.871225 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:46.880389 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-f47cb247-3921-4d2d-8b0c-7884f1973ebf tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.180212 Jul 21 23:00:46.881503 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 576/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:46 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:46.887813 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=4 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:47.030364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:47.038238 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-325b5a24-935e-4f3b-8513-35c7ce29428c tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.639898 Jul 21 23:00:47.038835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 536/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:46 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:47.142556 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:47.143335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] [instance: 714e3636-339b-4d42-89b1-e3a5a6736c71] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:47.150545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.151066 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.151869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.152306 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.166637 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] HTTP exception thrown: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Request method failure captured: Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 HTTP/1.1 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAHlNwtkHYy1N53bCrYmm6mA3EJOU1BCRiE8fyXW8lVrI-DWMrjHVupUgJMCNqTXr3kPwX1Pl_tMCaXraL2v4vSuQncK1BhlwM4fQoYaNKMYSN6vNhHQDa4tmJexOoK49o26OvW3p-eTgMYU6Wg7XAD-7JVGjMdpVN50_I0EG_zv8 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 93d60e3f3bcd48f292f30a8d2f0351d7 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-TestShelveInstance-1393077851 Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:00:47.168300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93d60e3f3bcd48f292f30a8d2f0351d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93d60e3f3bcd48f292f30a8d2f0351d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93d60e3f3bcd48f292f30a8d2f0351d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93d60e3f3bcd48f292f30a8d2f0351d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-TestShelveInstance-1393077851 Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 93d60e3f3bcd48f292f30a8d2f0351d7 Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-TestShelveInstance-1393077851 Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-TestShelveInstance-1393077851-project Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: a0a765202a9645a1acc332f559537458 Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-TestShelveInstance-1393077851-project Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. Jul 21 23:00:47.169749 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '714e3636-339b-4d42-89b1-e3a5a6736c71'} Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:47.170584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. Jul 21 23:00:47.171904 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:00:47.173098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Returning 404 to user: Instance 714e3636-339b-4d42-89b1-e3a5a6736c71 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:47.173098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dc93acde-a047-4f4e-b008-89726ac03fe2 tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71" status: 404 len: 111 microversion: 2.1 time: 0.031450 Jul 21 23:00:47.173098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 577/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:47 2022] GET /compute/v2.1/servers/714e3636-339b-4d42-89b1-e3a5a6736c71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:47.555201 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-323696f9-1833-434d-afb4-e8a1acc5d1be tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] Calling method '.version_select at 0x7fc5e42a2160>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:47.569543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=16 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:47.671651 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-323696f9-1833-434d-afb4-e8a1acc5d1be tempest-TestShelveInstance-1393077851 tempest-TestShelveInstance-1393077851-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-354995666" status: 202 len: 0 microversion: 2.1 time: 0.125886 Jul 21 23:00:47.672310 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 537/1114] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Jul 21 23:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-354995666 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:00:47.903135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:47.904738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:47.914312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.915202 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.917238 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.918294 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.065808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:48.066433 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:48.075491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.076216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.077900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.077900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.169144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:48.180097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5838aaa4-0049-40cf-939a-f47066a8db34 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.285547 Jul 21 23:00:48.181080 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 578/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:47 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:48.350393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:48.361966 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9a9033a1-036d-4438-9387-da3ca36d8b5b tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1314 microversion: 2.1 time: 0.310327 Jul 21 23:00:48.363064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 538/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:48 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:49.198183 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:49.199423 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:49.209014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.209014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.209385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.209988 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.380807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:49.381618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:49.393835 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.394616 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.396102 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.396551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.559899 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:49.569870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c26033df-03ae-495f-8748-f48cd5756b75 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.375521 Jul 21 23:00:49.571551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 579/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:49 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:49.722367 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:49.734593 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ecd2c8ec-04e5-4d60-b75b-77096b206ae2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1498 microversion: 2.1 time: 0.357798 Jul 21 23:00:49.736582 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 539/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:49 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1498 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:50.589146 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:50.590894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:50.604416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.604878 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.605668 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.606107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.679487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:50.680628 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:50.687830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.688690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.689808 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.690476 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.724478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:00:50.826148 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:50.840268 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e0113254-949e-41ac-bc6a-eeec1bbd947c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.254673 Jul 21 23:00:50.843113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 580/1119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:50 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:51.073434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-af3328ce-7cb4-4c97-9f7c-3769f41e3ef2 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 204 len: 0 microversion: 2.1 time: 0.398057 Jul 21 23:00:51.074121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 540/1120] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:00:50 2022] DELETE /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:00:51.082646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:51.083282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:51.089647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.090097 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.090901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.091339 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.235384 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:51.243892 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9d61bda3-9bc7-4213-b814-c5788cd8c836 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1504 microversion: 2.1 time: 0.165139 Jul 21 23:00:51.245198 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 581/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:51 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:51.382761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-e24748ee-eae4-45ee-ada6-8e12175c535a req-e12abf22-e1ae-466c-9d8b-f656b9d07117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5bc4f7-fb78-4187-86f7-c1968da77fd8", "name": "network-vif-plugged", "status": "completed", "tag": "f68facab-85d2-4dce-b7fe-29d6be7adca1"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:51.394064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e24748ee-eae4-45ee-ada6-8e12175c535a req-e12abf22-e1ae-466c-9d8b-f656b9d07117 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.394502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-e24748ee-eae4-45ee-ada6-8e12175c535a req-e12abf22-e1ae-466c-9d8b-f656b9d07117 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.408082 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-e24748ee-eae4-45ee-ada6-8e12175c535a req-e12abf22-e1ae-466c-9d8b-f656b9d07117 service nova] Creating event network-vif-plugged:f68facab-85d2-4dce-b7fe-29d6be7adca1 for instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 on hv-cinder-85069 Jul 21 23:00:51.414549 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-e24748ee-eae4-45ee-ada6-8e12175c535a req-e12abf22-e1ae-466c-9d8b-f656b9d07117 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036231 Jul 21 23:00:51.414749 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 541/1122] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:51.860997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:51.861718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:51.869407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.869993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.870787 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.871241 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.272215 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:52.283275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:52.296189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.297135 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.298268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.299656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.438859 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:52.447635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1691de8e-8426-45ce-8822-bb12a8572fb2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.590490 Jul 21 23:00:52.457251 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:52.458671 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 582/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:51 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:52.467162 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0c92619e-5497-46ff-8025-9da9edaeddb4 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1504 microversion: 2.1 time: 0.206537 Jul 21 23:00:52.467881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 542/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:52 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:53.335045 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-19b9d7ce-a29b-4084-8439-066b7d73505d req-43ce58d4-421c-4c66-bdb2-85d8f8a995d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d980f3d9-4df6-4d77-b5cc-033b2fba11b5", "name": "network-vif-deleted", "tag": "23a25184-d321-4db9-a3b9-3076cbe96a63"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:53.345262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-19b9d7ce-a29b-4084-8439-066b7d73505d req-43ce58d4-421c-4c66-bdb2-85d8f8a995d6 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.345709 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-19b9d7ce-a29b-4084-8439-066b7d73505d req-43ce58d4-421c-4c66-bdb2-85d8f8a995d6 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.350869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:53.359032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-19b9d7ce-a29b-4084-8439-066b7d73505d req-43ce58d4-421c-4c66-bdb2-85d8f8a995d6 service nova] Creating event network-vif-deleted:23a25184-d321-4db9-a3b9-3076cbe96a63 for instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 on hv-cinder-85069 Jul 21 23:00:53.364350 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-19b9d7ce-a29b-4084-8439-066b7d73505d req-43ce58d4-421c-4c66-bdb2-85d8f8a995d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Jul 21 23:00:53.364960 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 583/1125] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:53.464692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:53.465387 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:53.485142 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.485607 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.486406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.486866 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.493291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:53.498406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:53.507545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.507731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.508986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.509916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.611092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:53.624348 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-861f8218-658e-4be6-9a72-4576994a3871 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1462 microversion: 2.1 time: 0.140622 Jul 21 23:00:53.625416 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 584/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:53 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1462 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:53.802564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:53.812548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-26daf4c7-56a4-431f-a91b-7abb599175df tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1368 microversion: 2.1 time: 0.351660 Jul 21 23:00:53.813137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 543/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:53 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:54.641617 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:54.642227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:54.649484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.650317 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.650697 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.651152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.691289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.691890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.692860 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lazy-loading 'fault' on Instance uuid d980f3d9-4df6-4d77-b5cc-033b2fba11b5 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:00:54.767236 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932c6d0ae774493a852781e4c8d83e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429139a6e494a7290d91dd3cb8f712c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:54.781630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-28688f70-5203-4fab-8df3-c1e36a1d0cb9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 200 len: 1304 microversion: 2.1 time: 0.140117 Jul 21 23:00:54.785559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 585/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:54 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:54.830090 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:54.830868 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:54.839242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.840477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.841571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.842695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.061518 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:55.086372 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-97646767-fb9d-47ec-afa3-091dc64b4c9c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1559 microversion: 2.1 time: 0.258885 Jul 21 23:00:55.087935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 544/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:54 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:55.103380 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:55.107762 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:55.109844 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.110301 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.111094 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.111718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.192762 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-edc87c7c-7749-4588-926d-445a2bcef263 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093477 Jul 21 23:00:55.193465 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 586/1130] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Jul 21 23:00:55 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:00:55.804140 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:55.809979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] [instance: d980f3d9-4df6-4d77-b5cc-033b2fba11b5] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:55.811867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.812323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.813174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.813619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.828174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] HTTP exception thrown: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Request method failure captured: Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 HTTP/1.1 Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dptJ7H170358S8Zb3aBuWHb8oeKL_M00xxq_lMz5oz_1597upRTfXCM7LbJMN-yxilunVK7D2dXXzQQXcyMrTA4IB0iYGEq7D-D2DIujx91CYsUnWZ88M-OgySRJR6_oUogY6OPegZcS2Qhgxku0OdMIF0gMuMbE2GfnaW-9vmrbas Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 3429139a6e494a7290d91dd3cb8f712c Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesActionsTest-1775839 Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:00:55.829984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3429139a6e494a7290d91dd3cb8f712c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3429139a6e494a7290d91dd3cb8f712c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesActionsTest-1775839 Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 3429139a6e494a7290d91dd3cb8f712c Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesActionsTest-1775839 Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesActionsTest-1775839-project Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 932c6d0ae774493a852781e4c8d83e67 Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesActionsTest-1775839-project Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. Jul 21 23:00:55.832153 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'd980f3d9-4df6-4d77-b5cc-033b2fba11b5'} Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:00:55.833579 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. Jul 21 23:00:55.835197 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:00:55.836609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] Returning 404 to user: Instance d980f3d9-4df6-4d77-b5cc-033b2fba11b5 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:00:55.836609 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-24bc3aa6-8216-4dae-b213-ba551fa166b9 tempest-VolumesActionsTest-1775839 tempest-VolumesActionsTest-1775839-project] 10.222.0.52 "GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5" status: 404 len: 111 microversion: 2.1 time: 0.033592 Jul 21 23:00:55.844711 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 545/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:55 2022] GET /compute/v2.1/servers/d980f3d9-4df6-4d77-b5cc-033b2fba11b5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:00:56.552936 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-a6f1be42-e36a-4977-9bb5-d9ccfc71d682 req-c911b8ba-39d4-4cc6-8992-e21fb63f36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5bc4f7-fb78-4187-86f7-c1968da77fd8", "tag": "f68facab-85d2-4dce-b7fe-29d6be7adca1"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:00:56.565630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-a6f1be42-e36a-4977-9bb5-d9ccfc71d682 req-c911b8ba-39d4-4cc6-8992-e21fb63f36d4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:56.572734 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-a6f1be42-e36a-4977-9bb5-d9ccfc71d682 req-c911b8ba-39d4-4cc6-8992-e21fb63f36d4 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:56.580693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-a6f1be42-e36a-4977-9bb5-d9ccfc71d682 req-c911b8ba-39d4-4cc6-8992-e21fb63f36d4 service nova] Creating event network-changed:f68facab-85d2-4dce-b7fe-29d6be7adca1 for instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 on hv-cinder-85069 Jul 21 23:00:56.586381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-a6f1be42-e36a-4977-9bb5-d9ccfc71d682 req-c911b8ba-39d4-4cc6-8992-e21fb63f36d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038241 Jul 21 23:00:56.591363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 587/1132] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:09.229779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:09.231561 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:09.236847 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:09.238092 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:09.247979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.249757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.251405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.252106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.303203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-884af320-489e-475f-a30a-8091aaf0de1d tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075250 Jul 21 23:01:09.303781 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 546/1133] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Jul 21 23:01:09 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:09.374052 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:09.374629 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:09.383165 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=37 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:09.384541 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=21 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:09.386954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.387791 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.389079 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.389861 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.439786 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:01:09.833997 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-14c7d14c-51fa-4e60-a095-0b22daab4acb tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 204 len: 0 microversion: 2.20 time: 0.463954 Jul 21 23:01:09.843830 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:09.844453 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:09.846849 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 588/1134] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 21 23:01:09 2022] DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:01:09.852422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.863629 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.865944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.866583 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:10.162532 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:10.172419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:10.174181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:10.175509 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-ee1fa2f8-2a1a-48d0-966e-d59f081c68b9 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.335964 Jul 21 23:01:10.176555 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 547/1135] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:09 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:01:11.196345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:11.197062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:11.215871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.216615 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.217891 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.219292 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.461929 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:11.496941 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:11.507407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:11.517173 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d2c4a530-9d2e-4272-9fe5-75c3a3a52658 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.325951 Jul 21 23:01:11.518157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 589/1136] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:11 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:01:12.541552 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:12.542325 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:12.558096 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.560876 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:12.571395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.572217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.293444 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:13.319253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:13.324614 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:13.325874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-48f447e7-6426-41b5-ad2c-2df4edd3b309 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1722 microversion: 2.20 time: 0.791668 Jul 21 23:01:13.326471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 548/1137] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:12 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1722 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:01:13.801497 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-11bf2dcc-ee25-44ad-91e0-3f0093d24dab req-7b03bc54-a116-44d8-b547-dd0ed029019c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f3f2-2423-4a04-a163-87c15c57bafe", "name": "network-vif-deleted", "tag": "bfe9e93c-d1f9-4919-a48d-408be052b179"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:13.814444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-11bf2dcc-ee25-44ad-91e0-3f0093d24dab req-7b03bc54-a116-44d8-b547-dd0ed029019c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:13.814763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-11bf2dcc-ee25-44ad-91e0-3f0093d24dab req-7b03bc54-a116-44d8-b547-dd0ed029019c service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.842902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-11bf2dcc-ee25-44ad-91e0-3f0093d24dab req-7b03bc54-a116-44d8-b547-dd0ed029019c service nova] Creating event network-vif-deleted:bfe9e93c-d1f9-4919-a48d-408be052b179 for instance 8945f3f2-2423-4a04-a163-87c15c57bafe on hv-cinder-85069 Jul 21 23:01:13.849705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-11bf2dcc-ee25-44ad-91e0-3f0093d24dab req-7b03bc54-a116-44d8-b547-dd0ed029019c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051967 Jul 21 23:01:13.857106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 590/1138] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:14.359944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:14.360869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:14.375215 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.382479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.384007 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.384667 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.469600 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.472666 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.475626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lazy-loading 'fault' on Instance uuid 8945f3f2-2423-4a04-a163-87c15c57bafe {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:01:14.552393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:14.564815 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:14.566798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd10c68b7fd4446feb759832913fea3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7e8103418741398872d59d16e0e919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:14.572278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b7f6c116-8355-49dc-9403-f8bf8ce5fe87 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 200 len: 1370 microversion: 2.20 time: 0.231121 Jul 21 23:01:14.576859 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 549/1139] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:14 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:01:15.595504 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:15.598456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:15.634870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:15.635379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:15.636208 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:15.636646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:15.695696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe HTTP/1.1 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:15.699604 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:15.701178 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '8945f3f2-2423-4a04-a163-87c15c57bafe'} Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:15.701999 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:15.703802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:15.704945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:15.704945 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-114e6246-3822-40ad-83a6-5b8f48972600 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 404 len: 111 microversion: 2.20 time: 0.113774 Jul 21 23:01:15.705390 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 591/1140] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:15 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:01:15.713040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2a0d5b99-109e-4607-8be3-f71d98e1ca4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '.version_select at 0x7fc5e472bd30>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:15.851414 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2a0d5b99-109e-4607-8be3-f71d98e1ca4b tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576003966" status: 204 len: 0 microversion: 2.20 time: 0.142449 Jul 21 23:01:15.852011 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 550/1141] 10.222.0.52 () {60 vars in 1258 bytes} [Thu Jul 21 23:01:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576003966 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:01:17.657660 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5d19dbdd-38db-43f8-aa0e-4515513e8bbe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Action: 'create', calling method: .version_select at 0x7fc5d76a34c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1895998263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGCe6X36Z9SsTv7cvjpqL9u1rruIceP1Nh2HhvoKQlN7N60GlZwJXTZVRkq6FVfrBwMYwzSiIZ0yKREvRfHrE+JmJ+Mg5Cu8dqvL3eTKH9Md36w53HuBhR0xINUXq4D4g=="}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:17.674588 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-5d19dbdd-38db-43f8-aa0e-4515513e8bbe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:01:17.679647 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-5d19dbdd-38db-43f8-aa0e-4515513e8bbe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for user ae2a190cf2ef4777a3838cbe9750afea and project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'key_pairs'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:01:17.783432 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5d19dbdd-38db-43f8-aa0e-4515513e8bbe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.580050 Jul 21 23:01:17.784356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 592/1142] 10.222.0.52 () {60 vars in 1158 bytes} [Thu Jul 21 23:01:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:18.572654 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:18.573298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:18.594536 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:18.595379 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:18.596928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:18.601530 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:18.632874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe HTTP/1.1 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:01:18.635066 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.636928 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '8945f3f2-2423-4a04-a163-87c15c57bafe'} Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:18.637691 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.639013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.654338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:18.656578 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bfaf4e50-a627-4369-b86d-134f5042e312 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 404 len: 111 microversion: 2.20 time: 0.088188 Jul 21 23:01:18.660230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 551/1143] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 21 23:01:18 2022] DELETE /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:01:18.668802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:18.669472 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 8945f3f2-2423-4a04-a163-87c15c57bafe] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:18.681747 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:18.683682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:18.684775 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:18.690395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:18.728351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe HTTP/1.1 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:18.730322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.732261 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '8945f3f2-2423-4a04-a163-87c15c57bafe'} Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:18.734026 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. Jul 21 23:01:18.736125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:18.740017 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 8945f3f2-2423-4a04-a163-87c15c57bafe could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:18.741218 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3b9f0703-9783-4c6d-a361-9f1bce8edc08 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe" status: 404 len: 111 microversion: 2.20 time: 0.077154 Jul 21 23:01:18.742321 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 593/1144] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:18 2022] GET /compute/v2.1/servers/8945f3f2-2423-4a04-a163-87c15c57bafe => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:01:20.141864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:20.142449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:20.158504 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:20.159004 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:20.159839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:20.160277 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:20.177875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b HTTP/1.1 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:01:20.179760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.181570 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '5f228a73-c5cf-494a-8440-c15567b7618b'} Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:20.182524 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.184138 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.187244 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:20.189070 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fe7efd0f-41e3-4d0a-a90b-7a6e1e55908c tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 404 len: 111 microversion: 2.20 time: 0.051374 Jul 21 23:01:20.189646 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 552/1145] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Jul 21 23:01:20 2022] DELETE /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:01:20.199401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:20.199996 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] [instance: 5f228a73-c5cf-494a-8440-c15567b7618b] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:20.206688 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:20.207323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:20.209060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:20.209698 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:20.223841 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] HTTP exception thrown: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Request method failure captured: Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b HTTP/1.1 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2djkR98dzdqC9yoQa6eKBH-JbZ5wURk_tnVPQL-er_nlJu7DlwH-Uw7TykGb_p6reKPCNvR-RZT6dcLO-3nKxedEuvYA7ibHajcZn5uqJVUuERDwexcDqVuIw3bfuy2hQV52ag1XWp4pUOJ20kz_FQrjSemfcEL2s0EZhsJOh8jjjSo Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:20.225720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f7e8103418741398872d59d16e0e919", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f7e8103418741398872d59d16e0e919"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f7e8103418741398872d59d16e0e919"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 2f7e8103418741398872d59d16e0e919 Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-141103315 Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: d10c68b7fd4446feb759832913fea3b3 Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-141103315-project Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.227335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '5f228a73-c5cf-494a-8440-c15567b7618b'} Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:20.228120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. Jul 21 23:01:20.229657 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:20.232972 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] Returning 404 to user: Instance 5f228a73-c5cf-494a-8440-c15567b7618b could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:20.235060 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a8c2c243-eb4b-4f2b-89b1-d08e88daba11 tempest-AttachVolumeShelveTestJSON-141103315 tempest-AttachVolumeShelveTestJSON-141103315-project] 10.222.0.52 "GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b" status: 404 len: 111 microversion: 2.20 time: 0.039431 Jul 21 23:01:20.235666 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 594/1146] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Jul 21 23:01:20 2022] GET /compute/v2.1/servers/5f228a73-c5cf-494a-8440-c15567b7618b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:01:31.011502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-62a697f5-9d38-4e1a-bbf6-5ba7049f7ad5 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e635d820>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:31.018731 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:31.019503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=30 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:31.070216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-62a697f5-9d38-4e1a-bbf6-5ba7049f7ad5 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/998c5626-2936-458d-ac18-cf1373cf5403" status: 200 len: 350 microversion: 2.1 time: 0.062690 Jul 21 23:01:31.076775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 553/1147] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:01:31 2022] GET /compute/v2.1/os-volumes/998c5626-2936-458d-ac18-cf1373cf5403 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:32.760206 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7eafd4e9-cdcc-4de5-95b0-12d28bff7f62 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5d75030d0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:32.767871 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=4 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:32.768703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:32.769311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:32.813514 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7eafd4e9-cdcc-4de5-95b0-12d28bff7f62 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/974a9296-0227-42d8-8fe4-8ee1ba5d8ed9" status: 200 len: 351 microversion: 2.1 time: 0.058360 Jul 21 23:01:32.814086 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 595/1148] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:01:32 2022] GET /compute/v2.1/os-volumes/974a9296-0227-42d8-8fe4-8ee1ba5d8ed9 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:33.128916 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:33.129370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:33.138587 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:33.139097 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:33.139896 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:33.140338 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:33.166567 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-acb51a85-b41b-4091-9943-c04192e9c8d1 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/ips" status: 200 len: 151 microversion: 2.1 time: 0.042037 Jul 21 23:01:33.167759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 554/1149] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 23:01:33 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:34.688266 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-15a04441-3299-4ce1-a662-fc51993f72a1 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5d733ee50>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:34.763839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-15a04441-3299-4ce1-a662-fc51993f72a1 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9f4f0f0a-f58e-439e-a22b-4f8977737876" status: 200 len: 351 microversion: 2.1 time: 0.072897 Jul 21 23:01:34.763839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 596/1150] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:01:34 2022] GET /compute/v2.1/os-volumes/9f4f0f0a-f58e-439e-a22b-4f8977737876 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:34.769147 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b9d3377f-895e-4119-8a4d-fa4a3648fa7f tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e64c7c10>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:34.873800 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b9d3377f-895e-4119-8a4d-fa4a3648fa7f tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.108619 Jul 21 23:01:34.874376 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 555/1151] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jul 21 23:01:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:34.888453 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a5fe70b2-7fba-44f7-8b2b-78e53eb1f667 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5d7376c10>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.248257 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a5fe70b2-7fba-44f7-8b2b-78e53eb1f667 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.364289 Jul 21 23:01:35.249046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 597/1152] 10.222.0.52 () {58 vars in 1148 bytes} [Thu Jul 21 23:01:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:35.263318 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9b4beb98-ac7e-4a44-91b1-9846400fa7c5 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e4374160>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.300326 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ad5408a-fdb9-4a61-a170-95d286399d93"}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:35.302135 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:35.311096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:35.311909 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:35.313068 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:35.313721 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:35.398942 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9b4beb98-ac7e-4a44-91b1-9846400fa7c5 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.140357 Jul 21 23:01:35.399514 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 556/1153] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:35.410137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0b410d9c-68ed-4c3d-8604-4c0303796767 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e64423a0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.512468 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0b410d9c-68ed-4c3d-8604-4c0303796767 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.105829 Jul 21 23:01:35.513036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 557/1154] 10.222.0.52 () {58 vars in 1166 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:01:35.528074 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-0b663ca7-519f-49e1-8c53-b51e96a659f6 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e473a0d0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.621056 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-0b663ca7-519f-49e1-8c53-b51e96a659f6 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.099268 Jul 21 23:01:35.621760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 558/1155] 10.222.0.52 () {58 vars in 1169 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:01:35.634596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9dd09aa4-9c90-4e4e-85ea-f81cf3343763 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e44be670>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.722385 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9dd09aa4-9c90-4e4e-85ea-f81cf3343763 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092109 Jul 21 23:01:35.722979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 559/1156] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:35.734954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b8f1686d-d1fb-4435-b42d-3d2e2449f222 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e46a8c10>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.856395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b8f1686d-d1fb-4435-b42d-3d2e2449f222 tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123107 Jul 21 23:01:35.856395 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 560/1157] 10.222.0.52 () {58 vars in 1187 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:35.867606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-bd6f272c-2f86-4019-baa9-aa4031eee67f tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] Calling method '.version_select at 0x7fc5e4550430>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:35.979358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-bd6f272c-2f86-4019-baa9-aa4031eee67f tempest-VolumesTestJSON-1257050109 tempest-VolumesTestJSON-1257050109-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.116096 Jul 21 23:01:35.980678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 561/1158] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Jul 21 23:01:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:36.199850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-c1d3bcee-5c37-427e-806b-760a5211a425 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "POST /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903876 Jul 21 23:01:36.200495 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 598/1159] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Jul 21 23:01:35 2022] POST /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:42.123894 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1690938338", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895998263", "security_groups": [{"name": "tempest-secgroup-smoke-1407241131"}], "block_device_mapping_v2": [{"uuid": "d5ca0cea-27c2-427a-9df2-7a3f3f97ac80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f03e82bb-c5da-4cf0-a885-54a5fca0caf3"}]}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:42.252867 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.network.neutron [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] validate_networks() for [('f03e82bb-c5da-4cf0-a885-54a5fca0caf3', None, None, None, None, None)] {{(pid=124924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:01:43.018931 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:01:43.019484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image limits 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:01:43.019890 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:01:43.020301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image pref 0:0:0 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:01:43.020715 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.virt.hardware [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:01:43.030323 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:43.030780 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:43.031603 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:43.037112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:43.049076 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:01:43.053689 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.quota [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for user ae2a190cf2ef4777a3838cbe9750afea and project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:01:43.115223 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Going to run 1 instances... {{(pid=124924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:01:43.118129 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5ca0cea-27c2-427a-9df2-7a3f3f97ac80',volume_size=None,volume_type=None)] {{(pid=124924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:01:43.581659 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c3abc05f-4f8f-4b92-955a-bee45f19916c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.462257 Jul 21 23:01:43.583181 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 562/1160] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 23:01:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:01:43.595674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1486a857-4954-4d04-b055-a4779c505380 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:43.597203 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1486a857-4954-4d04-b055-a4779c505380 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:43.712783 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1486a857-4954-4d04-b055-a4779c505380 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:43.727214 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1486a857-4954-4d04-b055-a4779c505380 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1095 microversion: 2.1 time: 0.137138 Jul 21 23:01:43.730628 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 599/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:43 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1095 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:01:43.971043 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:43.971750 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:43.988238 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:43.988883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:43.989842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:43.991098 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:44.079447 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.objects.instance [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lazy-loading 'services' on Instance uuid 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 {{(pid=124924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:01:44.400842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-beaecef4-0cd4-4ff1-a1a1-2665d1515f33 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments/8ad5408a-fdb9-4a61-a170-95d286399d93" status: 202 len: 0 microversion: 2.1 time: 0.435237 Jul 21 23:01:44.402463 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 563/1162] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Jul 21 23:01:43 2022] DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments/8ad5408a-fdb9-4a61-a170-95d286399d93 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:01:44.411089 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:44.412092 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:44.426641 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:44.430113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:44.430113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:44.432474 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:44.498271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cf4e6c6f-0f2c-4b43-9789-cbaa182f1154 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091223 Jul 21 23:01:44.502473 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 600/1163] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:01:44 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:44.747660 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9d200cf7-be45-41ed-99eb-4f0053011028 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:44.748356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9d200cf7-be45-41ed-99eb-4f0053011028 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:44.802720 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9d200cf7-be45-41ed-99eb-4f0053011028 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:44.810217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9d200cf7-be45-41ed-99eb-4f0053011028 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1095 microversion: 2.1 time: 0.066891 Jul 21 23:01:44.810576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 564/1164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:44 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:45.510302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:45.511406 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:45.518652 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.519031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.519812 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.520245 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.565566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e5e2d183-2704-4c99-810b-9ba38dafb6ec tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059343 Jul 21 23:01:45.565727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 601/1165] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Jul 21 23:01:45 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:01:45.626898 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:45.627393 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:45.641275 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.642062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.643512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.649085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.685760 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:01:45.826364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:45.827002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:45.833293 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.834558 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.835673 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:45.836328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:45.908633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:45.918837 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4608a04a-f246-40bb-9aeb-302b860ec896 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1193 microversion: 2.1 time: 0.096196 Jul 21 23:01:45.919964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 602/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:45 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:01:46.029141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5ebc839d-4a4a-4499-8e5b-d4d82a2fba69 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 204 len: 0 microversion: 2.1 time: 0.404981 Jul 21 23:01:46.029141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 565/1167] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:01:45 2022] DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:01:46.039110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:46.039727 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:46.045729 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:46.046116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:46.047031 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:46.047487 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:46.194507 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:46.204204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a480cc3a-b312-4ebd-b852-ddbffece0a6c tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1684 microversion: 2.1 time: 0.169775 Jul 21 23:01:46.205736 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 603/1168] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:46 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:46.935979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:46.936682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:46.943945 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:46.944465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:46.945512 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:46.945954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:47.041078 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:47.049681 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-547fa9a2-461c-479d-a721-3701c782aa52 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1193 microversion: 2.1 time: 0.117920 Jul 21 23:01:47.050258 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 566/1169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:46 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:47.223142 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:47.223745 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:47.231176 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:47.231831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:47.232795 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:47.233393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:47.369134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:47.377543 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9d151141-a362-442b-aaaa-96a5deb0e374 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1684 microversion: 2.1 time: 0.158337 Jul 21 23:01:47.387444 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 604/1170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:47 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:48.067183 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:48.067963 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:48.079031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:48.081488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:48.082433 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:48.084205 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:48.197493 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:48.214010 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-332c2231-d62f-4442-8ccd-995aa014ac93 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1211 microversion: 2.1 time: 0.150680 Jul 21 23:01:48.226085 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 567/1171] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:48 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:48.394976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:48.396186 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:48.403782 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:48.404234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:48.405190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:48.405633 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:48.595311 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:48.605401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a0f0fc51-fff1-4e23-a52c-4fc1370071f9 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1684 microversion: 2.1 time: 0.214622 Jul 21 23:01:48.606530 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 605/1172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:48 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1684 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:49.123242 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-cf30e51f-46cc-4acb-96ab-c914a6193ef9 req-1d8cef6a-1f88-4867-b20a-28227e5103f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5bc4f7-fb78-4187-86f7-c1968da77fd8", "name": "network-vif-deleted", "tag": "f68facab-85d2-4dce-b7fe-29d6be7adca1"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:49.132302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-cf30e51f-46cc-4acb-96ab-c914a6193ef9 req-1d8cef6a-1f88-4867-b20a-28227e5103f6 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:49.132740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-cf30e51f-46cc-4acb-96ab-c914a6193ef9 req-1d8cef6a-1f88-4867-b20a-28227e5103f6 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:49.143779 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-cf30e51f-46cc-4acb-96ab-c914a6193ef9 req-1d8cef6a-1f88-4867-b20a-28227e5103f6 service nova] Creating event network-vif-deleted:f68facab-85d2-4dce-b7fe-29d6be7adca1 for instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 on hv-cinder-85069 Jul 21 23:01:49.149220 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-cf30e51f-46cc-4acb-96ab-c914a6193ef9 req-1d8cef6a-1f88-4867-b20a-28227e5103f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029608 Jul 21 23:01:49.149786 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 568/1173] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:49.233737 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:49.234445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:49.242934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:49.250928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:49.250928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:49.250928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:49.445371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:49.453125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8bdfc438-836d-4785-a881-bedcfe5c761a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1279 microversion: 2.1 time: 0.223269 Jul 21 23:01:49.453706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 606/1174] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:49 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:49.627706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:49.628670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:49.635923 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:49.637154 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:49.637575 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:49.638174 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:49.705592 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:49.713123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-f09b8b84-d235-4f5a-81f3-4c653919e389 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1616 microversion: 2.1 time: 0.091291 Jul 21 23:01:49.713924 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 569/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:49 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1616 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:50.472513 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:50.486722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:50.486722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:50.486722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:50.486722 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:50.487279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:50.620140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:50.627787 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-fde1dd64-aebb-438e-bd3e-3d9a70710987 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1279 microversion: 2.1 time: 0.160211 Jul 21 23:01:50.628361 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 607/1176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:50 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:01:50.730381 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:50.731031 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:50.737884 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:50.738332 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:50.739122 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:50.739554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:50.801716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:50.809437 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-67105724-7ce8-49d6-b8e2-134f0e5512ac tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1616 microversion: 2.1 time: 0.083231 Jul 21 23:01:50.810063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 570/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:50 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1616 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:51.645227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:51.645836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:51.652887 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:51.653335 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:51.654100 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:51.654538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:51.827290 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:51.828515 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:51.836539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:51.837279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:51.838061 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:51.838502 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:51.873731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:51.882975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-703c2fb3-37f8-4cce-bc4f-123c21d8185c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1279 microversion: 2.1 time: 0.241780 Jul 21 23:01:51.883797 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 608/1178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:51 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:51.913484 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c11dc2f4c764dc58458d9226efc878e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224678a5f1db4416b8175d315a4e4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:51.933219 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d0299283-ced7-4eeb-90bf-62e5e7e86033 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 200 len: 1327 microversion: 2.1 time: 0.109565 Jul 21 23:01:51.933809 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 571/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:51 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:52.601962 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-8c291071-6be1-4b4c-800d-268ed5ff14da req-fd7ae2e6-ef25-453f-b1f2-f5966414e3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404532b8-3cf9-4628-96f0-e9cc4d933460", "tag": "cbd42425-862a-42b1-87aa-80086b98c90c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:52.615910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-8c291071-6be1-4b4c-800d-268ed5ff14da req-fd7ae2e6-ef25-453f-b1f2-f5966414e3da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:52.616353 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-8c291071-6be1-4b4c-800d-268ed5ff14da req-fd7ae2e6-ef25-453f-b1f2-f5966414e3da service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:52.632593 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-8c291071-6be1-4b4c-800d-268ed5ff14da req-fd7ae2e6-ef25-453f-b1f2-f5966414e3da service nova] Creating event network-changed:cbd42425-862a-42b1-87aa-80086b98c90c for instance 404532b8-3cf9-4628-96f0-e9cc4d933460 on hv-cinder-85069 Jul 21 23:01:52.638445 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-8c291071-6be1-4b4c-800d-268ed5ff14da req-fd7ae2e6-ef25-453f-b1f2-f5966414e3da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041283 Jul 21 23:01:52.639599 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 609/1180] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:01:52.900539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:52.901075 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:52.909561 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:52.910434 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:52.912670 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:52.913342 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:52.950912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:52.951732 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:52.958644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:52.959149 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:52.960211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:52.960644 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:52.976151 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 HTTP/1.1 Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:52.978584 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:52.981548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '1d5bc4f7-fb78-4187-86f7-c1968da77fd8'} Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:52.983903 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:52.985573 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:52.987810 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:52.989596 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5b373959-7cf9-45ea-86d4-8ab97a0f3039 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 404 len: 111 microversion: 2.1 time: 0.043791 Jul 21 23:01:52.991221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 610/1181] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:52 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:01:52.999554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9745fde1-35a7-4d3d-bb2b-cf27dd9fc3a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '.version_select at 0x7fc5d72ff310>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:53.041869 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:53.065199 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:53.074400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1166cc11-82c5-49dc-82bc-64c0ae2c8f32 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1279 microversion: 2.1 time: 0.178177 Jul 21 23:01:53.075053 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 572/1182] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:52 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:53.122413 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9745fde1-35a7-4d3d-bb2b-cf27dd9fc3a5 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807641836" status: 202 len: 0 microversion: 2.1 time: 0.126739 Jul 21 23:01:53.123046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 611/1183] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Jul 21 23:01:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807641836 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:01:54.096417 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:54.096957 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:54.104207 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:54.106487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:54.106487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:54.106487 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:54.263912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:54.271846 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-63790d45-38a9-4797-9f6e-5bcae5726901 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.179329 Jul 21 23:01:54.272548 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 573/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:54 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:55.285836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:55.290848 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:55.292547 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:55.298221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:55.298662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:55.299461 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:55.299893 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:55.436731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:55.445096 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-37adc805-35b6-402f-a679-1b6a4c4b2222 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.160120 Jul 21 23:01:55.445676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 612/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:55 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:56.462316 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:56.462984 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:56.464793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=8 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:56.470169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:56.470619 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:56.471411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:56.471845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:56.616451 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:56.623921 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fffd846b-e73a-4f7a-b72a-431e4520c567 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.165989 Jul 21 23:01:56.624489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 574/1186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:56 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:57.640878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:57.641492 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:57.641881 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:57.642437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:57.652334 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.652784 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.653550 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.653979 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.661163 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.661612 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.662923 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.663350 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.678691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 HTTP/1.1 Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:57.680296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.682114 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '1d5bc4f7-fb78-4187-86f7-c1968da77fd8'} Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:57.683044 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.686267 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.690735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:57.690735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-31f4c7e3-dd93-416e-a852-e5603c087198 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 404 len: 111 microversion: 2.1 time: 0.051244 Jul 21 23:01:57.690735 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 613/1187] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:01:57 2022] DELETE /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:01:57.692005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:57.692704 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 1d5bc4f7-fb78-4187-86f7-c1968da77fd8] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:57.698741 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.699255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.700016 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:57.700624 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:57.720717 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 HTTP/1.1 Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:57.722467 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.724157 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '1d5bc4f7-fb78-4187-86f7-c1968da77fd8'} Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:57.725643 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. Jul 21 23:01:57.729531 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:57.733983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 1d5bc4f7-fb78-4187-86f7-c1968da77fd8 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:57.733983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1d32fb41-bba4-4a9a-a287-d5c5184d4ce4 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8" status: 404 len: 111 microversion: 2.1 time: 0.040601 Jul 21 23:01:57.733983 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 614/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:57 2022] GET /compute/v2.1/servers/1d5bc4f7-fb78-4187-86f7-c1968da77fd8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:01:57.814013 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:57.822018 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b51ce249-024f-4ee5-9cfd-ff2fb0058b6b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.185113 Jul 21 23:01:57.822597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 575/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:57 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:58.838862 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:58.839559 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:58.846076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:58.846616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:58.847524 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:58.848019 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.002599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:59.003127 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:59.005147 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:59.009948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.010405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.011230 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.011676 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.012935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1f23cb0a-db95-4ed1-aa61-abf44634a0db tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.178099 Jul 21 23:01:59.013506 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 615/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:58 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:59.026241 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb HTTP/1.1 Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:01:59.027534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.029650 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '35fff0c7-83f1-445a-b6e0-32d1f5831ecb'} Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:59.030735 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.032479 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.034333 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:59.034333 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-6d55a09e-26dc-4778-8ebc-768f5736b2af tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 404 len: 111 microversion: 2.1 time: 0.030334 Jul 21 23:01:59.034333 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 576/1191] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:01:58 2022] DELETE /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:01:59.038483 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:59.039002 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 35fff0c7-83f1-445a-b6e0-32d1f5831ecb] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:59.047220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.047220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.047220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.047220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.062355 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb HTTP/1.1 Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:59.063851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.065536 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '35fff0c7-83f1-445a-b6e0-32d1f5831ecb'} Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:59.067103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. Jul 21 23:01:59.068804 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.070134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 35fff0c7-83f1-445a-b6e0-32d1f5831ecb could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:59.070134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d92fb792-2ac2-4a41-b132-14427b580c80 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb" status: 404 len: 111 microversion: 2.1 time: 0.031412 Jul 21 23:01:59.070134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 616/1192] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:59 2022] GET /compute/v2.1/servers/35fff0c7-83f1-445a-b6e0-32d1f5831ecb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:01:59.074618 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:59.075400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:59.081845 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.082741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.083491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.083951 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.111751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 HTTP/1.1 Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:01:59.116203 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.117724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'a0a2b99f-a099-4b41-8f45-90670baf9a15'} Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:59.118483 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.119819 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.121656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:59.121656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-715b3155-88f8-4d52-b125-42b23ab1cdc0 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 404 len: 111 microversion: 2.1 time: 0.044057 Jul 21 23:01:59.121656 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 577/1193] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:01:59 2022] DELETE /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:01:59.125310 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:59.125919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: a0a2b99f-a099-4b41-8f45-90670baf9a15] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:59.132211 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.132663 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.133463 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:59.133894 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:59.149025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 HTTP/1.1 Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:01:59.150620 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.152296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': 'a0a2b99f-a099-4b41-8f45-90670baf9a15'} Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:01:59.153098 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. Jul 21 23:01:59.154371 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:01:59.155598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance a0a2b99f-a099-4b41-8f45-90670baf9a15 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:01:59.155598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3b11dd63-f2ae-4ecd-8fb7-fac1573e95d2 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15" status: 404 len: 111 microversion: 2.1 time: 0.032079 Jul 21 23:01:59.155598 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 617/1194] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:59 2022] GET /compute/v2.1/servers/a0a2b99f-a099-4b41-8f45-90670baf9a15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:02:00.035235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:00.035917 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:00.042719 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.043288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.044180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.044672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.191803 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:00.199900 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-586f09a0-3423-4d25-ad41-b0a5b6fd6b8a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.168633 Jul 21 23:02:00.200465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 578/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:00 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:00.452750 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:00.453300 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:00.459890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.460345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.461107 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.462523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.475385 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a HTTP/1.1 Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:02:00.476964 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.478635 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '493bb0f1-8dde-4694-8e46-35e451a66b7a'} Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:00.479865 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.481396 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.483420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:00.483420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-25a2473a-1a49-4e62-9470-84c18aaab31d tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 404 len: 111 microversion: 2.1 time: 0.029673 Jul 21 23:02:00.483420 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 618/1196] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:02:00 2022] DELETE /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:02:00.489340 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:00.489993 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] [instance: 493bb0f1-8dde-4694-8e46-35e451a66b7a] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:00.496672 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.497117 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.497918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:00.498355 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:00.502416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:00.511662 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] HTTP exception thrown: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Request method failure captured: Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a HTTP/1.1 Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dlAKUFyiynDG0o12BEsjGL8hRgUkmYPwiSd75hj1u8GAWfTuBIEDVGL10edVUVVra-NS7rcS2Si7xSbWDAcVzal-pBJykHj1n4OcPvEt2PvUbYZRnptPztRTv2U5c74Z9w_zce1XOWhIRzCGBXnkiNSPdM86f1BA5gm2aLVAmcRrDM Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:02:00.513497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224678a5f1db4416b8175d315a4e4a0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224678a5f1db4416b8175d315a4e4a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 224678a5f1db4416b8175d315a4e4a0d Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-508863006 Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 8c11dc2f4c764dc58458d9226efc878e Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-AttachVolumeNegativeTest-508863006-project Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.515134 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '493bb0f1-8dde-4694-8e46-35e451a66b7a'} Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:00.516035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. Jul 21 23:02:00.517411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:00.518503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] Returning 404 to user: Instance 493bb0f1-8dde-4694-8e46-35e451a66b7a could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:00.518503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3709ccbc-a1c6-4258-a36f-865082c2f576 tempest-AttachVolumeNegativeTest-508863006 tempest-AttachVolumeNegativeTest-508863006-project] 10.222.0.52 "GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a" status: 404 len: 111 microversion: 2.1 time: 0.029491 Jul 21 23:02:00.518503 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 579/1197] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:00 2022] GET /compute/v2.1/servers/493bb0f1-8dde-4694-8e46-35e451a66b7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:02:01.215993 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:01.217018 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:01.223190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:01.223856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:01.226691 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:01.227491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:01.442478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:01.448627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:01.451282 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-181045d7-e51c-4b73-9932-02856d709011 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.239107 Jul 21 23:02:01.451928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 619/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:01 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:02.469580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:02.471041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:02.483302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:02.483302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:02.483302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:02.483302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:02.641433 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:02.651072 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1e1436b6-b41a-4761-ae2f-f9f3ffec6677 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.186032 Jul 21 23:02:02.660838 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 580/1199] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:02 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:03.688025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:03.688025 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:03.739076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:03.739076 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:03.740761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:03.744037 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:04.042252 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:04.051417 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7866b56f-c5d0-4a6d-8ec2-9796bf6d6a39 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.386134 Jul 21 23:02:04.055455 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 620/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:03 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:05.072161 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:05.073419 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:05.078764 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:05.081571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:05.082020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:05.083119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:05.083280 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:05.230836 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:05.238462 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7d1142d8-6e69-4360-a4d9-73c6f69f1c9d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.170641 Jul 21 23:02:05.239054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 581/1201] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:05 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:06.254422 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:06.256521 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:06.259006 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:06.263773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:06.264223 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:06.265701 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:06.266313 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:06.405004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:06.415934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0e987cb5-137d-454b-9ce1-e51187b7edb6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.165397 Jul 21 23:02:06.416485 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 621/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:06 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:06.856516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3a4bbe9f-2907-47f4-9209-cdf12c550621 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Action: 'create', calling method: .version_select at 0x7fc5e4755820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1907678505", "metadata": {"Type": "work"}}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:07.432616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:07.433249 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:07.440262 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:07.440712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:07.441469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:07.441910 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:07.591116 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:07.602845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e425026c-a82f-485a-bf38-f504bbd8f303 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.173883 Jul 21 23:02:07.603912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 622/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:07 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:07.643471 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3a4bbe9f-2907-47f4-9209-cdf12c550621 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.901083 Jul 21 23:02:07.644123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 582/1204] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 21 23:02:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 902 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 23:02:07.655111 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-3da67ed6-1a04-4c67-92ad-fb921260158f tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d7570e50>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:07.702442 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-3da67ed6-1a04-4c67-92ad-fb921260158f tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.051180 Jul 21 23:02:07.703041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 623/1205] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:07 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:08.619911 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:08.620527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:08.626638 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:08.627126 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:08.627898 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:08.628335 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:08.714843 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-e8342b67-9b5a-4f80-9bf6-4233de3330f6 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d753f4c0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:08.758840 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:08.760394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-e8342b67-9b5a-4f80-9bf6-4233de3330f6 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.049721 Jul 21 23:02:08.760971 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 624/1206] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:08 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:02:08.766888 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-d986abc8-df4c-4ffe-8bd4-33620525ce7e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.151265 Jul 21 23:02:08.767449 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 583/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:08 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:09.773931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-91541712-77b9-492e-a124-43a42665538a tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d72ff310>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:09.784307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:09.784912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:09.792378 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:09.792912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:09.793784 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:09.794221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:09.837756 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-91541712-77b9-492e-a124-43a42665538a tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.068698 Jul 21 23:02:09.844271 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 625/1208] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:09 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:09.932918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:09.940366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-645fee4b-fc3e-46dd-9cbe-4590a4fd0c0f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.160473 Jul 21 23:02:09.940932 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 584/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:09 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:02:10.855318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9ad12111-02c8-4d6b-ac70-4c3591ab82ed tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d7376ca0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:10.901210 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9ad12111-02c8-4d6b-ac70-4c3591ab82ed tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.050356 Jul 21 23:02:10.901778 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 626/1210] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:10 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:02:10.956501 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:10.957112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:10.963302 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:10.963755 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:10.964516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:10.964950 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:11.100040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:11.107791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-a1d963c9-d45e-4274-9e91-28e140f05ff7 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.155063 Jul 21 23:02:11.108279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 585/1211] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:10 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:11.914105 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1a6b43f8-b76c-4aba-9c3e-4339a27773bc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d75e3e50>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:11.960836 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1a6b43f8-b76c-4aba-9c3e-4339a27773bc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.051036 Jul 21 23:02:11.961553 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 627/1212] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:11 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:12.124576 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:12.125188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:12.132289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:12.132740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:12.133518 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:12.133952 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:12.264347 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:12.273396 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-aabbf01a-161a-45b3-8aa2-1bb223c4aff5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.152664 Jul 21 23:02:12.273974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 586/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:12 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:12.973920 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1d77c349-f95d-4fcf-b673-6e7bc738bf42 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d72ff040>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:13.262961 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1d77c349-f95d-4fcf-b673-6e7bc738bf42 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 354 microversion: 2.1 time: 0.293464 Jul 21 23:02:13.276106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 628/1214] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:12 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:02:13.277554 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1c7a661d-3cbc-427f-897f-d624e04d4a59 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5e449aee0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:13.289848 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:13.290554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:13.310197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:13.310197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:13.310197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:13.310197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:13.358169 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1c7a661d-3cbc-427f-897f-d624e04d4a59 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 354 microversion: 2.1 time: 0.086669 Jul 21 23:02:13.358833 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 587/1215] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:13 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:13.370988 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-99fddf8e-d7d2-474d-ab52-874ab726fcfc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5e45da9d0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:13.460854 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:13.468356 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ff756d5d-1dac-40a8-830e-ac48c18134ed tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.182672 Jul 21 23:02:13.468994 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 629/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:13 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:02:13.610375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-99fddf8e-d7d2-474d-ab52-874ab726fcfc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 202 len: 0 microversion: 2.1 time: 0.243093 Jul 21 23:02:13.611005 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 588/1217] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 23:02:13 2022] DELETE /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:02:13.619718 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b2ab9e06-52bc-4105-b3cc-ea52ead83a5e tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d7376820>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:13.665383 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b2ab9e06-52bc-4105-b3cc-ea52ead83a5e tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.050247 Jul 21 23:02:13.665957 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 630/1218] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:13 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:14.485822 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:14.486599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:14.493448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:14.494017 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:14.494687 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:14.495152 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:14.631260 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:14.639087 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-490fe6a2-23d0-4599-a468-1c1ed8035c8d tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.157527 Jul 21 23:02:14.639864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 589/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:14 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:14.677919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-638e3a69-40bb-438d-ab81-37c1da3685fc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d72ff790>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:14.695112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-ff4c8a09-9981-469d-81ce-874b7262ee66 req-04a8f449-b2b7-470e-a120-9c3979f550b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404532b8-3cf9-4628-96f0-e9cc4d933460", "name": "network-vif-plugged", "status": "completed", "tag": "cbd42425-862a-42b1-87aa-80086b98c90c"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:14.703411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-ff4c8a09-9981-469d-81ce-874b7262ee66 req-04a8f449-b2b7-470e-a120-9c3979f550b3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:14.703861 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-ff4c8a09-9981-469d-81ce-874b7262ee66 req-04a8f449-b2b7-470e-a120-9c3979f550b3 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:14.715824 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-ff4c8a09-9981-469d-81ce-874b7262ee66 req-04a8f449-b2b7-470e-a120-9c3979f550b3 service nova] Creating event network-vif-plugged:cbd42425-862a-42b1-87aa-80086b98c90c for instance 404532b8-3cf9-4628-96f0-e9cc4d933460 on hv-cinder-85069 Jul 21 23:02:14.721046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-ff4c8a09-9981-469d-81ce-874b7262ee66 req-04a8f449-b2b7-470e-a120-9c3979f550b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Jul 21 23:02:14.721644 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 590/1220] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:14.729693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-638e3a69-40bb-438d-ab81-37c1da3685fc tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.052745 Jul 21 23:02:14.729693 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 631/1221] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:14 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:15.657357 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:15.658046 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:15.664767 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:15.665212 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:15.665969 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:15.666405 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:15.738656 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4567f337-c3d0-4d4d-8b48-b45013b04277 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d75e39d0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:15.789549 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4567f337-c3d0-4d4d-8b48-b45013b04277 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.055097 Jul 21 23:02:15.790123 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 632/1222] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:15 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:02:15.801597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:15.809359 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cb19f67c-b752-432e-a4a6-ef36dec1c2fe tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.156782 Jul 21 23:02:15.809977 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 591/1223] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:15 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:16.803181 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-24d72048-a886-4cff-a326-2fa7ad5513b9 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d75701f0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:16.825401 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:16.826022 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:16.832817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:16.833271 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:16.834034 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:16.834470 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:16.850714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-24d72048-a886-4cff-a326-2fa7ad5513b9 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 200 len: 353 microversion: 2.1 time: 0.052585 Jul 21 23:02:16.851627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 633/1224] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:16 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:16.966864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:16.974695 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2f08856c-feb9-4bf5-aec8-774f278c2b10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.152647 Jul 21 23:02:16.976139 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 592/1225] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:16 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:17.864867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a73a8731-9059-437e-9206-0d016edd6fe1 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Calling method '.version_select at 0x7fc5d753f3a0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:17.993450 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:17.994892 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:17.998742 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-a73a8731-9059-437e-9206-0d016edd6fe1 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] HTTP exception thrown: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a73a8731-9059-437e-9206-0d016edd6fe1 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Request method failure captured: Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f HTTP/1.1 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2druHS3Qq4npIAQZPI2xPQ0yGr3kPg-uep7Zyy1VcaOGeIJVC_IEjssc3XI4k1_egpCo0qciE2yXilXr5tkZ9PBBQRw1VsKD2J5Ox0_CeO_kq-WDyy0W4wax8VXPBVAZ8g4tBqToAW1ptTzmspOzHvgy1kkzawMHTeRxbcExMz3EoR0 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 9963be03a1e84a698a67707390b7240a Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesGetTestJSON-1478850026 Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:02:18.000714 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9963be03a1e84a698a67707390b7240a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9963be03a1e84a698a67707390b7240a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9963be03a1e84a698a67707390b7240a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9963be03a1e84a698a67707390b7240a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesGetTestJSON-1478850026 Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 9963be03a1e84a698a67707390b7240a Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesGetTestJSON-1478850026 Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesGetTestJSON-1478850026-project Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 08d24284ad884d0699814870576e1c7f Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesGetTestJSON-1478850026-project Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '86175c4e-0dfb-4dd9-9227-bbeedd95ce2f'} Jul 21 23:02:18.002152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. (HTTP 404) (Request-ID: req-14beef66-d9cc-4b74-bd8b-65c87a2abbf6) Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:18.003124 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:02:18.004407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:02:18.006312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:18.009039 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a73a8731-9059-437e-9206-0d016edd6fe1 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] Returning 404 to user: Volume 86175c4e-0dfb-4dd9-9227-bbeedd95ce2f could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:18.009947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:18.009947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:18.010125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a73a8731-9059-437e-9206-0d016edd6fe1 tempest-VolumesGetTestJSON-1478850026 tempest-VolumesGetTestJSON-1478850026-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f" status: 404 len: 109 microversion: 2.1 time: 0.141767 Jul 21 23:02:18.010125 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 634/1226] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:17 2022] GET /compute/v2.1/os-volumes/86175c4e-0dfb-4dd9-9227-bbeedd95ce2f => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:02:18.010316 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:18.010316 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:18.158388 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:18.165944 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fe59c713-f9ce-405e-a595-aa86eb9f29eb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1267 microversion: 2.1 time: 0.177350 Jul 21 23:02:18.166545 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 593/1227] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:17 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:02:19.190201 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:19.194241 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:19.208299 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:19.210430 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:19.214802 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:19.216870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:19.359113 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:19.366807 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ddf9c562-636c-4880-9c03-cce57d45afc9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1455 microversion: 2.1 time: 0.187964 Jul 21 23:02:19.367382 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 635/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:19 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:19.383465 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:19.384067 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:02:19.390491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:19.394948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:19.394948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:19.394948 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:19.543954 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:02:19.551976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2a23eb10-33ad-4ada-9038-065136658cc2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1455 microversion: 2.1 time: 0.172942 Jul 21 23:02:19.553121 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 594/1229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:02:19 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:02:20.552686 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-75255d8b-bdb5-4b92-9b65-045e04ca92ef tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Action: 'create', calling method: .version_select at 0x7fc5d7570dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1968826555", "metadata": {"Type": "work"}}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-75255d8b-bdb5-4b92-9b65-045e04ca92ef tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 122 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:02:20.577234 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1968826555", "metadata": {"Type": "work"}}} Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 23:02:20.587700 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1968826555', 'metadata': {'Type': 'work'}}}} Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.589358 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:02:20.591172 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:02:20.592676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:02:20.592676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.592676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-75255d8b-bdb5-4b92-9b65-045e04ca92ef tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.592676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-75255d8b-bdb5-4b92-9b65-045e04ca92ef tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.173574 Jul 21 23:02:20.592676 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 636/1230] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 21 23:02:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:02:20.594489 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e9806e2a-7fa7-4e92-92e3-33ce77629577 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Action: 'create', calling method: .version_select at 0x7fc5e460ae50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1114811463", "metadata": {"Type": "work"}}} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e9806e2a-7fa7-4e92-92e3-33ce77629577 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 120 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:02:20.598442 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1114811463", "metadata": {"Type": "work"}}} Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: Jul 21 23:02:20.600807 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1114811463', 'metadata': {'Type': 'work'}}}} Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi '0' Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.601757 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:02:20.603166 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:02:20.604772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:02:20.604772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.604772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-e9806e2a-7fa7-4e92-92e3-33ce77629577 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.604772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-e9806e2a-7fa7-4e92-92e3-33ce77629577 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011091 Jul 21 23:02:20.604772 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 595/1231] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 21 23:02:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:02:20.611512 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cbb94432-72df-4cb0-a50f-c57630b67c11 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Action: 'create', calling method: .version_select at 0x7fc5d753ff70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-113830362", "metadata": {"Type": "work"}}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cbb94432-72df-4cb0-a50f-c57630b67c11 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 118 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:02:20.615579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-113830362", "metadata": {"Type": "work"}}} Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 23:02:20.617221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-113830362', 'metadata': {'Type': 'work'}}}} Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi '' Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.618372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:02:20.620020 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:02:20.621526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:02:20.621526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.622484 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cbb94432-72df-4cb0-a50f-c57630b67c11 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.623498 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cbb94432-72df-4cb0-a50f-c57630b67c11 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016553 Jul 21 23:02:20.624247 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 637/1232] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Jul 21 23:02:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:02:20.635288 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5b36a47-01c2-4651-b90f-fbd1c65fca5a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Calling method '.version_select at 0x7fc5e4899f70>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:20.672505 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-b5b36a47-01c2-4651-b90f-fbd1c65fca5a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] HTTP exception thrown: Volume tempest-invalid-1186276822 could not be found. Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5b36a47-01c2-4651-b90f-fbd1c65fca5a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1186276822 HTTP/1.1 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:02:20.682083 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Volume tempest-invalid-1186276822 could not be found. Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'tempest-invalid-1186276822'} Jul 21 23:02:20.683741 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1186276822 could not be found. (HTTP 404) (Request-ID: req-00aa8c64-1b7a-4902-9427-b76e036e73e4) Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.684716 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:02:20.686400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1186276822 could not be found. Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:20.687843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1186276822 could not be found. Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1186276822 could not be found. Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-b5b36a47-01c2-4651-b90f-fbd1c65fca5a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 404 to user: Volume tempest-invalid-1186276822 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-b5b36a47-01c2-4651-b90f-fbd1c65fca5a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1186276822" status: 404 len: 99 microversion: 2.1 time: 0.047206 Jul 21 23:02:20.689112 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 596/1233] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Jul 21 23:02:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1186276822 => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 23:02:20.691517 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4ef1191e-f30b-477f-9b19-2f97ab1c3897 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003795 Jul 21 23:02:20.691517 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 638/1234] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Jul 21 23:02:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 23:02:20.698146 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-35f87cca-2e82-4b10-80f4-b3b8873f483a tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003829 Jul 21 23:02:20.703553 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 597/1235] 10.222.0.52 () {58 vars in 1136 bytes} [Thu Jul 21 23:02:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 23:02:20.709923 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-446e344e-1ed2-47c0-b81f-6bc233d08eba tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Calling method '.version_select at 0x7fc5d7376ee0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:20.744618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-446e344e-1ed2-47c0-b81f-6bc233d08eba tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] HTTP exception thrown: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-446e344e-1ed2-47c0-b81f-6bc233d08eba tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/os-volumes/71958cfb-bd8f-4872-82e4-081a0d0273cc HTTP/1.1 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:02:20.750712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '71958cfb-bd8f-4872-82e4-081a0d0273cc'} Jul 21 23:02:20.752395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. (HTTP 404) (Request-ID: req-fc0cdee0-ece2-44d2-a176-0a3ab519d972) Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.753544 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:02:20.755768 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:02:20.757159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-446e344e-1ed2-47c0-b81f-6bc233d08eba tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 404 to user: Volume 71958cfb-bd8f-4872-82e4-081a0d0273cc could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-446e344e-1ed2-47c0-b81f-6bc233d08eba tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/71958cfb-bd8f-4872-82e4-081a0d0273cc" status: 404 len: 109 microversion: 2.1 time: 0.044115 Jul 21 23:02:20.758434 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 639/1236] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Jul 21 23:02:20 2022] DELETE /compute/v2.1/os-volumes/71958cfb-bd8f-4872-82e4-081a0d0273cc => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:02:20.764771 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-07e5ba1f-2336-454a-9207-88c5d232e844 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Calling method '.version_select at 0x7fc5e45a99d0>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:02:20.793971 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-07e5ba1f-2336-454a-9207-88c5d232e844 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] HTTP exception thrown: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-07e5ba1f-2336-454a-9207-88c5d232e844 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Request method failure captured: Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/os-volumes/a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 HTTP/1.1 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dr8nYpZZy8kDYP1G_7RGWBaYCrHatkcLLKEjd-CijGIJRSbjQaFf_eVgAw2v2ztxUz5rJu9gGMJCpZwk2-Yxd6wLi4gZ7W6tqdSXZ9oZROWzm8i1Rhppnr00mIHwNDwqre8XpEEbkkkI_aU82BAempmCPv_1_cvFApIYDY9kRy6uW4 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:02:20.795947 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cf2fec2943c4371844d205ae919d1ac", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cf2fec2943c4371844d205ae919d1ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 7cf2fec2943c4371844d205ae919d1ac Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-VolumesNegativeTest-315870787 Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: 4bc0d32aeb384ac08160a20a07a885fe Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-VolumesNegativeTest-315870787-project Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'a3e193e8-d4eb-4fff-9fdf-d26e3c65b914'} Jul 21 23:02:20.797588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. (HTTP 404) (Request-ID: req-a979fba2-e361-4707-9677-e6cfc1978922) Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.798597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:02:20.803399 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:02:20.804872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-07e5ba1f-2336-454a-9207-88c5d232e844 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] Returning 404 to user: Volume a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-07e5ba1f-2336-454a-9207-88c5d232e844 tempest-VolumesNegativeTest-315870787 tempest-VolumesNegativeTest-315870787-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a3e193e8-d4eb-4fff-9fdf-d26e3c65b914" status: 404 len: 109 microversion: 2.1 time: 0.039836 Jul 21 23:02:20.806421 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 598/1237] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Jul 21 23:02:20 2022] GET /compute/v2.1/os-volumes/a3e193e8-d4eb-4fff-9fdf-d26e3c65b914 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:02:22.373931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-337b673a-81d8-47aa-92c4-751b176f13ae req-1a3ada86-9848-43fe-a69b-df4dbd0ab556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404532b8-3cf9-4628-96f0-e9cc4d933460", "tag": "cbd42425-862a-42b1-87aa-80086b98c90c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:22.383243 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-337b673a-81d8-47aa-92c4-751b176f13ae req-1a3ada86-9848-43fe-a69b-df4dbd0ab556 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:22.384063 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-337b673a-81d8-47aa-92c4-751b176f13ae req-1a3ada86-9848-43fe-a69b-df4dbd0ab556 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:22.396372 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-337b673a-81d8-47aa-92c4-751b176f13ae req-1a3ada86-9848-43fe-a69b-df4dbd0ab556 service nova] Creating event network-changed:cbd42425-862a-42b1-87aa-80086b98c90c for instance 404532b8-3cf9-4628-96f0-e9cc4d933460 on hv-cinder-85069 Jul 21 23:02:22.402435 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-337b673a-81d8-47aa-92c4-751b176f13ae req-1a3ada86-9848-43fe-a69b-df4dbd0ab556 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033354 Jul 21 23:02:22.403905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 640/1238] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:04:11.263480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:04:11.264118 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:04:20.735960 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cda192c8-f4f4-498e-829c-beda08cf97c0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 23:04:20.736626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=21 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:20.737345 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=68 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:20.741569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:20.742054 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:20.748177 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:20.748558 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:20.749307 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:20.749739 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:20.775041 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Going to try to terminate instance {{(pid=124924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:04:21.005343 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-44487772-0abe-4604-afcc-be7e52678000 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "DELETE /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 204 len: 0 microversion: 2.1 time: 0.270707 Jul 21 23:04:21.005883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 599/1239] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:04:20 2022] DELETE /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:04:21.013189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4d151e1-e7c8-4e23-86fc-0625eb5e7732] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 23:04:21.013771 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=9 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:21.014502 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=32 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:21.018935 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:21.019619 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:21.025646 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:21.026091 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:21.026869 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:21.027298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:21.312744 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:21.320204 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1b26fad8-f4c7-4bac-86b7-f708c18be3bc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1580 microversion: 2.1 time: 0.308909 Jul 21 23:04:21.320806 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 641/1240] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:21 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1580 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:22.338843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:22.339577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:22.347216 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:22.347665 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:22.348429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:22.348865 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:22.366912 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] [cda192c8-f4f4-498e-829c-beda08cf97c0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 32868. Jul 21 23:04:22.540571 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:22.548101 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8b637ade-5c51-4f67-9d18-230bd8d87f10 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1580 microversion: 2.1 time: 0.214224 Jul 21 23:04:22.548674 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 600/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:22 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1580 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:23.482050 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4d151e1-e7c8-4e23-86fc-0625eb5e7732] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 32878. Jul 21 23:04:23.541856 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-208948ac-4874-4530-a638-a555bba29fc7 req-5c7af414-838c-43f1-8468-c39ea4f62af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404532b8-3cf9-4628-96f0-e9cc4d933460", "name": "network-vif-deleted", "tag": "cbd42425-862a-42b1-87aa-80086b98c90c"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:04:23.550574 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-208948ac-4874-4530-a638-a555bba29fc7 req-5c7af414-838c-43f1-8468-c39ea4f62af8 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:23.551049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-208948ac-4874-4530-a638-a555bba29fc7 req-5c7af414-838c-43f1-8468-c39ea4f62af8 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:23.564456 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-208948ac-4874-4530-a638-a555bba29fc7 req-5c7af414-838c-43f1-8468-c39ea4f62af8 service nova] Creating event network-vif-deleted:cbd42425-862a-42b1-87aa-80086b98c90c for instance 404532b8-3cf9-4628-96f0-e9cc4d933460 on hv-cinder-85069 Jul 21 23:04:23.568539 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:23.569813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-208948ac-4874-4530-a638-a555bba29fc7 req-5c7af414-838c-43f1-8468-c39ea4f62af8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102958 Jul 21 23:04:23.571144 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 642/1242] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:04:23.572523 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:23.597522 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:23.599052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:23.599052 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:23.599332 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:23.679551 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:23.684268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2d99319c-2bda-44b6-b9f1-973451aa0f64 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1512 microversion: 2.1 time: 0.122077 Jul 21 23:04:23.685221 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 601/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:23 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1512 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:24.717995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:24.717995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:24.717995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:24.717995 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:24.720040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:24.720040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:24.753681 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:24.754126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:24.754566 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.objects.instance [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lazy-loading 'fault' on Instance uuid 404532b8-3cf9-4628-96f0-e9cc4d933460 {{(pid=124925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:04:24.795934 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:24.803893 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5488c4c4-f226-4d5f-8e39-bbc6cec82532 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 200 len: 1231 microversion: 2.1 time: 0.105221 Jul 21 23:04:24.804470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 643/1244] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:24 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:25.822706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:25.823276 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:25.829765 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:25.830243 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:25.831040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:25.831480 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:25.844588 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] HTTP exception thrown: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Request method failure captured: Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 HTTP/1.1 Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dqzv0JlRkN5gVQzYFZNb1eD0A18XWfjk53IJ9ngf_2uVzUUJD_KNTkkfWNFePdoo8gECHz6zoZfHHmlKRkwxg4RySMFCTsptCY2SjYJrDNf5RZboPdzB8Qx29Sa-O3PuMvzSXEAgWIrRxoJkvpvvxiug9g73VYRaVtXmsBEsUay--w Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:04:25.846202 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_24a2b49707184c4093e713f0bbc5b00c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-TestVolumeBootPattern-702275152 Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ae2a190cf2ef4777a3838cbe9750afea Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:04:25.848133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '404532b8-3cf9-4628-96f0-e9cc4d933460'} Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:04:25.849188 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:04:25.850580 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:04:25.852382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Returning 404 to user: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:04:25.852382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-c0e4e2e4-86ef-465a-855f-1bb9ed75a2d9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 404 len: 111 microversion: 2.1 time: 0.028968 Jul 21 23:04:25.852382 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 602/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:25 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:04:25.940388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-255939627", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895998263", "security_groups": [{"name": "tempest-secgroup-smoke-1407241131"}], "block_device_mapping_v2": [{"uuid": "d5ca0cea-27c2-427a-9df2-7a3f3f97ac80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f03e82bb-c5da-4cf0-a885-54a5fca0caf3"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:04:26.049720 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] validate_networks() for [('f03e82bb-c5da-4cf0-a885-54a5fca0caf3', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:04:26.465197 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:04:26.465627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:04:26.466190 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:04:26.466616 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:04:26.467062 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:04:26.475564 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:26.476007 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:26.476825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:26.477255 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:26.493781 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:04:26.497696 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for user ae2a190cf2ef4777a3838cbe9750afea and project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:04:26.553152 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:04:26.555259 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5ca0cea-27c2-427a-9df2-7a3f3f97ac80',volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:04:27.012931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d9f62a73-831d-4c0f-a10a-26ac451ae42a tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076272 Jul 21 23:04:27.013931 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 644/1246] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 23:04:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:04:27.023875 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-5ebffe8a-bd55-4bfe-97a2-5e12be1f8760 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:27.024577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-5ebffe8a-bd55-4bfe-97a2-5e12be1f8760 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:27.102477 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-5ebffe8a-bd55-4bfe-97a2-5e12be1f8760 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:27.109542 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-5ebffe8a-bd55-4bfe-97a2-5e12be1f8760 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1094 microversion: 2.1 time: 0.089448 Jul 21 23:04:27.110369 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 603/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:27 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:28.127533 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:28.128145 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:28.135754 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:28.136215 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:28.136975 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:28.137454 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:28.199655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:28.207318 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b5a07f38-7c83-4996-9193-8f43a959d4d6 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1144 microversion: 2.1 time: 0.084256 Jul 21 23:04:28.211712 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 645/1248] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:28 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:04:29.224782 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:29.232119 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:29.234194 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:29.234647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:29.235455 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:29.235908 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:29.302848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:29.312848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-3a2c3bf8-074d-463b-b78f-eeed431c6c3e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1200 microversion: 2.1 time: 0.091613 Jul 21 23:04:29.313606 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 604/1249] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:29 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:30.329773 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:30.330391 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:30.337706 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:30.338155 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:30.338968 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:30.339424 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:30.627834 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:30.636019 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-cc9c9d69-8c9a-4b27-a2e0-1c2e39020b2f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1278 microversion: 2.1 time: 0.310313 Jul 21 23:04:30.636674 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 646/1250] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:30 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:31.203168 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-3e267487-f8af-47c7-a262-a3ce9e5eb968 req-db96325b-23d9-43f6-a25d-5af13bc9c1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a258c9-7bf8-4872-8e94-5c4419dc474c", "tag": "9980b81a-c935-403b-b1f1-19c836209f02"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:04:31.213020 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-3e267487-f8af-47c7-a262-a3ce9e5eb968 req-db96325b-23d9-43f6-a25d-5af13bc9c1cc service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:31.213577 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-3e267487-f8af-47c7-a262-a3ce9e5eb968 req-db96325b-23d9-43f6-a25d-5af13bc9c1cc service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:31.227048 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-3e267487-f8af-47c7-a262-a3ce9e5eb968 req-db96325b-23d9-43f6-a25d-5af13bc9c1cc service nova] Creating event network-changed:9980b81a-c935-403b-b1f1-19c836209f02 for instance 75a258c9-7bf8-4872-8e94-5c4419dc474c on hv-cinder-85069 Jul 21 23:04:31.232584 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-3e267487-f8af-47c7-a262-a3ce9e5eb968 req-db96325b-23d9-43f6-a25d-5af13bc9c1cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034664 Jul 21 23:04:31.233200 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 605/1251] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:04:31.653526 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:31.654227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:31.660919 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:31.661298 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:31.662067 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:31.662502 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:31.889167 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:31.896713 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-46999e48-cfce-49b8-8239-d14ea7395115 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.247640 Jul 21 23:04:31.897279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 647/1252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:31 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:32.914093 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:32.914801 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:32.921036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:32.921485 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:32.922246 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:32.922682 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:33.050740 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:33.058690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-7de9608d-9ca1-464b-8b98-c15eaa55471e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.149300 Jul 21 23:04:33.059301 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 606/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:32 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:34.075933 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:34.076545 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:34.083073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:34.083523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:34.084291 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:34.084728 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:34.216577 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:34.224049 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-718d7567-d797-4b2a-b0f0-e05618516197 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.152040 Jul 21 23:04:34.224618 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 648/1254] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:34 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:35.241027 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:35.241640 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:35.248253 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:35.248703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:35.249496 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:35.249935 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:35.384207 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:35.391710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-74f0a666-c28f-46c1-93a4-c1bd352a155e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.154570 Jul 21 23:04:35.392285 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 607/1255] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:35 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:36.408870 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:36.409478 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:36.416621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:36.417074 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:36.417846 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:36.418284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:36.485328 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:36.503831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:36.552239 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:36.560272 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1b8300e6-7a7c-422d-8267-c788bdd99ea5 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.155282 Jul 21 23:04:36.560850 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 649/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:36 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:37.577084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:37.577709 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:37.580123 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:04:37.585024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:37.585472 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:37.586289 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:37.586751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:37.718516 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:37.726024 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-59edf5d9-4c22-48ea-82aa-aea6104a0209 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.152813 Jul 21 23:04:37.727126 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 608/1257] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:37 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:38.743845 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:38.744381 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:38.750911 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:38.751364 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:38.752130 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:38.752567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:38.890612 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:38.898069 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-dbf91d2e-15f8-417f-8d03-835df920f4f4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.158393 Jul 21 23:04:38.898630 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 650/1258] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:38 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:39.915527 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:39.916137 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:39.922595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:39.923079 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:39.923848 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:39.924286 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:40.056590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:40.064069 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-842f86d7-dd26-4419-a8fd-3edc2044bb76 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.153089 Jul 21 23:04:40.064648 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 609/1259] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:39 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:41.081296 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:41.081902 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:41.089040 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:41.092351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:41.092351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:41.092351 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:41.224986 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:41.233469 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2970e454-ec15-489c-9c3b-1e1707b62b18 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.156092 Jul 21 23:04:41.234041 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 651/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:41 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:42.250217 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:42.250791 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:42.257452 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:42.258062 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:42.258851 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:42.259279 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:42.387390 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:42.394763 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-87e143a0-22d2-430b-b7a8-aa490bed4790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.148563 Jul 21 23:04:42.395346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 610/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:42 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:43.312005 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-e3383f54-dd77-4265-9840-ccd9d43959f5 req-ce459b20-d4d7-497d-a54b-ab64407b6a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a258c9-7bf8-4872-8e94-5c4419dc474c", "name": "network-vif-plugged", "status": "completed", "tag": "9980b81a-c935-403b-b1f1-19c836209f02"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:04:43.320450 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e3383f54-dd77-4265-9840-ccd9d43959f5 req-ce459b20-d4d7-497d-a54b-ab64407b6a24 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:43.320890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-e3383f54-dd77-4265-9840-ccd9d43959f5 req-ce459b20-d4d7-497d-a54b-ab64407b6a24 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:43.331655 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-e3383f54-dd77-4265-9840-ccd9d43959f5 req-ce459b20-d4d7-497d-a54b-ab64407b6a24 service nova] Creating event network-vif-plugged:9980b81a-c935-403b-b1f1-19c836209f02 for instance 75a258c9-7bf8-4872-8e94-5c4419dc474c on hv-cinder-85069 Jul 21 23:04:43.336982 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-e3383f54-dd77-4265-9840-ccd9d43959f5 req-ce459b20-d4d7-497d-a54b-ab64407b6a24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083415 Jul 21 23:04:43.337581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 652/1262] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:04:43.413569 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:43.414223 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:43.420929 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:43.421429 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:43.422180 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:43.422617 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:43.557019 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:43.564445 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-52b63adf-9b73-4b7b-942b-8a129c3566b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.154863 Jul 21 23:04:43.569842 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 611/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:43 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:44.638954 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:44.639670 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:44.646027 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:44.646466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:44.647270 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:44.647699 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:44.788038 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:44.795827 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-ad529c02-6a07-4859-ba61-2b7a4734e688 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1266 microversion: 2.1 time: 0.161647 Jul 21 23:04:44.796394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 653/1264] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:44 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:04:45.812820 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:45.813356 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:45.820724 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:45.821250 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:45.822026 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:45.822459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:45.959881 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:45.967298 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-9dbd345f-3355-4081-befe-49146fb1eaef tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1454 microversion: 2.1 time: 0.158448 Jul 21 23:04:45.967872 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 612/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:45 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:04:45.983785 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:04:45.984394 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:04:45.990877 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:45.991331 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:45.992731 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:45.993174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:46.123409 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:04:46.131110 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-2765158e-4cfb-45e2-8ea5-58e059d649dc tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1454 microversion: 2.1 time: 0.151388 Jul 21 23:04:46.131667 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 654/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:04:45 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:04:48.011064 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-4945272d-e53e-459a-b143-6b3366a98944 req-8490994d-8105-4fd8-bf91-23215f6a3269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a258c9-7bf8-4872-8e94-5c4419dc474c", "tag": "9980b81a-c935-403b-b1f1-19c836209f02"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:04:48.019692 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-4945272d-e53e-459a-b143-6b3366a98944 req-8490994d-8105-4fd8-bf91-23215f6a3269 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:04:48.020141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-4945272d-e53e-459a-b143-6b3366a98944 req-8490994d-8105-4fd8-bf91-23215f6a3269 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:04:48.031063 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-4945272d-e53e-459a-b143-6b3366a98944 req-8490994d-8105-4fd8-bf91-23215f6a3269 service nova] Creating event network-changed:9980b81a-c935-403b-b1f1-19c836209f02 for instance 75a258c9-7bf8-4872-8e94-5c4419dc474c on hv-cinder-85069 Jul 21 23:04:48.037364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-4945272d-e53e-459a-b143-6b3366a98944 req-8490994d-8105-4fd8-bf91-23215f6a3269 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030589 Jul 21 23:04:48.037965 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 613/1267] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:05:05.509466 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:05:05.509948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:05:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:06:23.541302 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:23.542137 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=74 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:23.546073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-686942855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895998263", "security_groups": [{"name": "tempest-secgroup-smoke-1407241131"}], "block_device_mapping_v2": [{"uuid": "673bca10-940e-4a66-80f4-80b59f01ce29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f03e82bb-c5da-4cf0-a885-54a5fca0caf3"}]}} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:06:23.661327 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.network.neutron [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] validate_networks() for [('f03e82bb-c5da-4cf0-a885-54a5fca0caf3', None, None, None, None, None)] {{(pid=124925) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:06:24.286103 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:06:24.286551 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image limits 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:06:24.287056 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Flavor pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:06:24.287464 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Image pref 0:0:0 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:06:24.287872 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.virt.hardware [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:06:24.297323 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:24.297770 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:24.298567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:24.299109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:24.315500 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:06:24.319739 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.quota [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Getting quotas for user ae2a190cf2ef4777a3838cbe9750afea and project 24a2b49707184c4093e713f0bbc5b00c. Resources: {'ram', 'instances', 'cores'} {{(pid=124925) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:06:24.377120 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Going to run 1 instances... {{(pid=124925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:06:24.379276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='673bca10-940e-4a66-80f4-80b59f01ce29',volume_size=None,volume_type=None)] {{(pid=124925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:06:24.725164 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-adb9129c-c11f-4a4f-b3e3-60c6dd263675 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.185508 Jul 21 23:06:24.726126 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 655/1268] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Jul 21 23:06:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:06:24.734590 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cda192c8-f4f4-498e-829c-beda08cf97c0] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 21 23:06:24.735364 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:24.736107 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:24.740726 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-1cacadbc-79fd-48b2-9cc8-123b9809827b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:24.741422 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-1cacadbc-79fd-48b2-9cc8-123b9809827b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:24.795406 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-1cacadbc-79fd-48b2-9cc8-123b9809827b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:24.803073 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-1cacadbc-79fd-48b2-9cc8-123b9809827b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1094 microversion: 2.1 time: 0.070373 Jul 21 23:06:24.806106 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 614/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:24 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:25.820290 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:25.820905 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:25.827166 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:25.827621 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:25.828387 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:25.828825 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:25.891458 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:25.898817 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-0692b20c-9eef-447b-9df9-32a8bd8a9da1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1136 microversion: 2.1 time: 0.082853 Jul 21 23:06:25.899395 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 656/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:25 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:26.917212 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:26.924366 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:26.928416 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:26.929930 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:26.930817 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:26.931363 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:26.959133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] [cda192c8-f4f4-498e-829c-beda08cf97c0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 33056. Jul 21 23:06:27.019844 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:27.027543 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-42a3bf39-d63c-496a-b1cc-e53177c19790 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1210 microversion: 2.1 time: 0.114979 Jul 21 23:06:27.028491 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 615/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:26 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:28.045014 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:28.045627 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:28.052567 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:28.054831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:28.054831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:28.054831 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:28.263868 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:28.275227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9664f1f9-5f02-4cdf-863f-3c54bcbc3e65 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1278 microversion: 2.1 time: 0.230489 Jul 21 23:06:28.275227 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 657/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:28 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:28.435192 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-a501dcd7-5213-4323-b679-f5c874918dfb req-c726e1b5-6e4f-448e-b09c-0dc31f833f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb830f95-8d49-41c0-bc52-9145ff57f556", "tag": "bb64eca6-e5fc-43d2-a3a5-9d0def8b0230"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:06:28.444346 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a501dcd7-5213-4323-b679-f5c874918dfb req-c726e1b5-6e4f-448e-b09c-0dc31f833f14 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:28.444793 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-a501dcd7-5213-4323-b679-f5c874918dfb req-c726e1b5-6e4f-448e-b09c-0dc31f833f14 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:28.457339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-a501dcd7-5213-4323-b679-f5c874918dfb req-c726e1b5-6e4f-448e-b09c-0dc31f833f14 service nova] Creating event network-changed:bb64eca6-e5fc-43d2-a3a5-9d0def8b0230 for instance bb830f95-8d49-41c0-bc52-9145ff57f556 on hv-cinder-85069 Jul 21 23:06:28.470038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-a501dcd7-5213-4323-b679-f5c874918dfb req-c726e1b5-6e4f-448e-b09c-0dc31f833f14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038490 Jul 21 23:06:28.470671 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 616/1273] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:06:29.288998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:29.289705 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:29.297095 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:29.297529 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:29.298276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:29.298703 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:29.488393 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:29.496642 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-949c5a86-7fea-4bab-bedf-6f41a0c8d8b8 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.211621 Jul 21 23:06:29.503890 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 658/1274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:29 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:30.515110 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:30.515805 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:30.521994 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:30.522444 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:30.523235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:30.523678 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:30.654339 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:30.661843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-214fa3cc-eb20-43a5-b635-704f8d81fe99 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.152065 Jul 21 23:06:30.662411 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 617/1275] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:30 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:31.678485 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:31.679119 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:31.685600 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:31.686048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:31.686839 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:31.687278 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:31.814462 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:31.821918 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-056d92c1-8cdb-4a15-9c15-2e7d26a97674 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.147379 Jul 21 23:06:31.822491 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 659/1276] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:31 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:32.838679 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:32.839317 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:32.845864 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:32.846306 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:32.847089 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:32.847520 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:32.972979 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:32.980761 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-cd423d5d-8fa0-417d-8dd9-2d3b80318c72 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.145972 Jul 21 23:06:32.981572 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 618/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:32 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:33.998078 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:33.998678 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:34.005159 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:34.005602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:34.006346 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:34.006799 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:34.137926 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:34.145284 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-7f226cbc-61c3-4263-9368-4cc9575b6389 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.151574 Jul 21 23:06:34.145851 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 660/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:33 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:35.161874 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:35.162400 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:35.164798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell0:SELECT=2 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:35.169703 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:35.170151 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:35.170925 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:35.171404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:35.308295 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:35.315723 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-fb30493c-1eb8-4a80-914f-7f65d60d41d4 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.157766 Jul 21 23:06:35.316291 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 619/1279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:35 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:36.332263 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:36.332867 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:36.334662 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=2 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:36.335336 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell0:SELECT=6 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:36.341189 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:36.344156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:36.344156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:36.344156 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:36.471756 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:36.479916 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-d4847303-3118-4810-acd2-bc7f88321362 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.151455 Jul 21 23:06:36.483216 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 661/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:36 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:37.498001 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:37.498494 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:37.505040 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:37.505490 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:37.506247 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:37.506680 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:37.636547 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:37.644488 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-60a7001f-9137-40a6-b708-285bba64d68c tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.151044 Jul 21 23:06:37.645050 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 620/1281] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:37 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:38.661925 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:38.662538 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:38.669221 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:38.669673 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:38.670439 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:38.670908 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:38.801639 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:38.809818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-5d33f15d-06d5-4485-b4d5-a4b1c6f84573 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.151741 Jul 21 23:06:38.810379 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 662/1282] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:38 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:39.826658 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:39.827360 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:39.833805 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:39.834259 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:39.835057 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:39.835476 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:39.914397 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [req-2437214b-a2db-4217-ab6a-fedd5f46492b req-b4e84e60-b7ab-4fdf-b405-26a201fcad0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb830f95-8d49-41c0-bc52-9145ff57f556", "name": "network-vif-plugged", "status": "completed", "tag": "bb64eca6-e5fc-43d2-a3a5-9d0def8b0230"}]} {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:06:39.923852 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-2437214b-a2db-4217-ab6a-fedd5f46492b req-b4e84e60-b7ab-4fdf-b405-26a201fcad0e service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:39.924287 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [req-2437214b-a2db-4217-ab6a-fedd5f46492b req-b4e84e60-b7ab-4fdf-b405-26a201fcad0e service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:39.935976 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.compute.server_external_events [req-2437214b-a2db-4217-ab6a-fedd5f46492b req-b4e84e60-b7ab-4fdf-b405-26a201fcad0e service nova] Creating event network-vif-plugged:bb64eca6-e5fc-43d2-a3a5-9d0def8b0230 for instance bb830f95-8d49-41c0-bc52-9145ff57f556 on hv-cinder-85069 Jul 21 23:06:39.941102 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [req-2437214b-a2db-4217-ab6a-fedd5f46492b req-b4e84e60-b7ab-4fdf-b405-26a201fcad0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Jul 21 23:06:39.941753 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 663/1283] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:06:39.977312 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:39.985086 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-2e4cffc6-4999-4948-b4b4-a6aab160652b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.162997 Jul 21 23:06:39.985647 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 621/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:39 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:41.002822 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:41.003542 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:41.010250 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:41.010692 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:41.011479 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:41.011912 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:41.139363 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:41.146695 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b6477627-eefc-4107-b5b7-3b7174e537f1 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1266 microversion: 2.1 time: 0.148582 Jul 21 23:06:41.147286 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 664/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:40 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:42.163834 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:42.164475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:42.171583 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:42.172035 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:42.172798 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:42.173240 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:42.310294 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:42.318304 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-8a596630-a5ad-4b17-92dd-5fb2d0acaceb tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1454 microversion: 2.1 time: 0.158295 Jul 21 23:06:42.319084 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 622/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:42 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:42.334140 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:42.334790 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:06:42.341811 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:42.342264 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:42.343065 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:42.343505 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:42.474482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:06:42.482947 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-8761ccbe-bf8f-4b86-89f4-16a9b0f0c37f tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1454 microversion: 2.1 time: 0.152614 Jul 21 23:06:42.483518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 665/1287] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:06:42 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:06:44.640733 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-87db0d35-a991-4094-a86f-07641f94e0d4 req-a7bef5e8-c959-44a6-8a41-7ff5a377a895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb830f95-8d49-41c0-bc52-9145ff57f556", "tag": "bb64eca6-e5fc-43d2-a3a5-9d0def8b0230"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:06:44.649370 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-87db0d35-a991-4094-a86f-07641f94e0d4 req-a7bef5e8-c959-44a6-8a41-7ff5a377a895 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:06:44.649878 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-87db0d35-a991-4094-a86f-07641f94e0d4 req-a7bef5e8-c959-44a6-8a41-7ff5a377a895 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:06:44.661057 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-87db0d35-a991-4094-a86f-07641f94e0d4 req-a7bef5e8-c959-44a6-8a41-7ff5a377a895 service nova] Creating event network-changed:bb64eca6-e5fc-43d2-a3a5-9d0def8b0230 for instance bb830f95-8d49-41c0-bc52-9145ff57f556 on hv-cinder-85069 Jul 21 23:06:44.666182 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-87db0d35-a991-4094-a86f-07641f94e0d4 req-a7bef5e8-c959-44a6-8a41-7ff5a377a895 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029165 Jul 21 23:06:44.666980 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 623/1288] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:06:44.695340 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:06:44.695631 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:07:31.272775 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:07:31.273475 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:08:16.107244 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:08:16.107992 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG dbcounter [-] [124925] Writing DB stats nova_cell1:SELECT=58 {{(pid=124925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:08:16.110596 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_api:SELECT=22 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:08:16.111478 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG dbcounter [-] [124924] Writing DB stats nova_cell1:SELECT=46 {{(pid=124924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:08:16.112377 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:16.113013 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:16.116351 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-11034199-861e-4e98-88e6-fde3e6a416c5 req-a2365da5-4471-44b8-ae98-724d40e2a885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb830f95-8d49-41c0-bc52-9145ff57f556", "tag": "bb64eca6-e5fc-43d2-a3a5-9d0def8b0230"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:08:16.121048 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:16.121508 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:16.122443 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:16.122914 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:16.125448 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-11034199-861e-4e98-88e6-fde3e6a416c5 req-a2365da5-4471-44b8-ae98-724d40e2a885 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:16.125885 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-11034199-861e-4e98-88e6-fde3e6a416c5 req-a2365da5-4471-44b8-ae98-724d40e2a885 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:16.138597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-11034199-861e-4e98-88e6-fde3e6a416c5 req-a2365da5-4471-44b8-ae98-724d40e2a885 service nova] Creating event network-changed:bb64eca6-e5fc-43d2-a3a5-9d0def8b0230 for instance bb830f95-8d49-41c0-bc52-9145ff57f556 on hv-cinder-85069 Jul 21 23:08:16.143941 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-11034199-861e-4e98-88e6-fde3e6a416c5 req-a2365da5-4471-44b8-ae98-724d40e2a885 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035429 Jul 21 23:08:16.144534 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 624/1289] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:08:16.149764 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:08:16.390106 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4433a41e-d9c1-4322-8dbc-6d4ed3676118 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 204 len: 0 microversion: 2.1 time: 0.284487 Jul 21 23:08:16.393729 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 666/1290] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:08:16 2022] DELETE /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:08:16.400420 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:16.401375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:16.409038 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:16.409564 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:16.413352 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:16.413816 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:16.563266 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:16.570883 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-49acd7c4-c0eb-48ee-bb3b-dbd52ed0c2f9 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1578 microversion: 2.1 time: 0.174932 Jul 21 23:08:16.571459 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 625/1291] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:16 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:08:17.590174 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:17.590897 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:17.597586 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:17.598032 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:17.598813 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:17.599251 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:17.793401 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:17.800952 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-603b8202-913a-4b53-8be3-8bc552616155 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1578 microversion: 2.1 time: 0.215199 Jul 21 23:08:17.801523 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 667/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:17 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:08:18.441693 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-c5d1baf0-461e-4e89-bedd-3f2bf0fb93ce req-2bc02586-4efc-4f8b-a1c6-60c0f179a320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb830f95-8d49-41c0-bc52-9145ff57f556", "name": "network-vif-deleted", "tag": "bb64eca6-e5fc-43d2-a3a5-9d0def8b0230"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:08:18.450690 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c5d1baf0-461e-4e89-bedd-3f2bf0fb93ce req-2bc02586-4efc-4f8b-a1c6-60c0f179a320 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:18.453268 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-c5d1baf0-461e-4e89-bedd-3f2bf0fb93ce req-2bc02586-4efc-4f8b-a1c6-60c0f179a320 service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:18.462044 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-c5d1baf0-461e-4e89-bedd-3f2bf0fb93ce req-2bc02586-4efc-4f8b-a1c6-60c0f179a320 service nova] Creating event network-vif-deleted:bb64eca6-e5fc-43d2-a3a5-9d0def8b0230 for instance bb830f95-8d49-41c0-bc52-9145ff57f556 on hv-cinder-85069 Jul 21 23:08:18.467839 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-c5d1baf0-461e-4e89-bedd-3f2bf0fb93ce req-2bc02586-4efc-4f8b-a1c6-60c0f179a320 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030370 Jul 21 23:08:18.468412 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 626/1293] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:08:18.822024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:18.822024 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:18.826154 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:18.826600 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:18.827388 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:18.827818 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:18.890482 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:18.897988 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-4fba6695-c3ee-4572-99f5-cc23a35d11ea tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 200 len: 1225 microversion: 2.1 time: 0.083599 Jul 21 23:08:18.898581 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 668/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:18 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:08:19.915183 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:19.915871 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: bb830f95-8d49-41c0-bc52-9145ff57f556] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:19.923297 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:19.923748 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:19.924522 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:19.924976 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:19.937986 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] HTTP exception thrown: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Request method failure captured: Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 HTTP/1.1 Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dqzv0JlRkN5gVQzYFZNb1eD0A18XWfjk53IJ9ngf_2uVzUUJD_KNTkkfWNFePdoo8gECHz6zoZfHHmlKRkwxg4RySMFCTsptCY2SjYJrDNf5RZboPdzB8Qx29Sa-O3PuMvzSXEAgWIrRxoJkvpvvxiug9g73VYRaVtXmsBEsUay--w Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:08:19.939597 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_24a2b49707184c4093e713f0bbc5b00c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ae2a190cf2ef4777a3838cbe9750afea Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. Jul 21 23:08:19.941358 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': 'bb830f95-8d49-41c0-bc52-9145ff57f556'} Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:19.942375 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. Jul 21 23:08:19.943852 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:19.945599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Returning 404 to user: Instance bb830f95-8d49-41c0-bc52-9145ff57f556 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:19.945599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-88f827f2-e618-40c0-b276-e79d27997c30 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 21 23:08:19.945599 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 627/1295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:19 2022] GET /compute/v2.1/servers/bb830f95-8d49-41c0-bc52-9145ff57f556 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:08:23.517948 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:23.518493 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:23.519704 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-84a6453e-24e2-4f55-8cbe-aab4520088cc req-a8ef1ac2-6f7d-41b0-82ab-d806a33963ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a258c9-7bf8-4872-8e94-5c4419dc474c", "tag": "9980b81a-c935-403b-b1f1-19c836209f02"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:08:23.524763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:23.525312 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:23.526322 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:23.526761 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:23.529235 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-84a6453e-24e2-4f55-8cbe-aab4520088cc req-a8ef1ac2-6f7d-41b0-82ab-d806a33963ee service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:23.529751 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-84a6453e-24e2-4f55-8cbe-aab4520088cc req-a8ef1ac2-6f7d-41b0-82ab-d806a33963ee service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:23.541595 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-84a6453e-24e2-4f55-8cbe-aab4520088cc req-a8ef1ac2-6f7d-41b0-82ab-d806a33963ee service nova] Creating event network-changed:9980b81a-c935-403b-b1f1-19c836209f02 for instance 75a258c9-7bf8-4872-8e94-5c4419dc474c on hv-cinder-85069 Jul 21 23:08:23.546903 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-84a6453e-24e2-4f55-8cbe-aab4520088cc req-a8ef1ac2-6f7d-41b0-82ab-d806a33963ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030697 Jul 21 23:08:23.547759 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 628/1296] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:08:23.554220 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Going to try to terminate instance {{(pid=124925) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:08:23.876879 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a313b9cd-7550-489e-a2a8-3fb33837da9b tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 204 len: 0 microversion: 2.1 time: 0.361048 Jul 21 23:08:23.877829 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 669/1297] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:08:23 2022] DELETE /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:08:23.887272 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:23.888497 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:23.896427 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:23.898036 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:23.898828 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:23.899706 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:24.035133 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.policy [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:24.043278 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-117df1b9-f8cf-4603-b160-d47c9f6341df tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1579 microversion: 2.1 time: 0.160483 Jul 21 23:08:24.043850 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 629/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:23 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:08:25.063974 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:25.064672 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:25.071199 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:25.071738 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:25.073068 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:25.073497 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:25.204518 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:25.212009 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-9c528797-2661-4a75-a82d-f44fd856016e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1460 microversion: 2.1 time: 0.152359 Jul 21 23:08:25.212579 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 670/1299] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:25 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:08:25.518109 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:08:25.518279 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:08:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:08:25.868773 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [req-9bdc02fc-4029-4812-aee4-065d009ccb97 req-3dbd1ea5-f1c0-46a0-9943-c2912109007b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a258c9-7bf8-4872-8e94-5c4419dc474c", "name": "network-vif-deleted", "tag": "9980b81a-c935-403b-b1f1-19c836209f02"}]} {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:08:25.877441 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9bdc02fc-4029-4812-aee4-065d009ccb97 req-3dbd1ea5-f1c0-46a0-9943-c2912109007b service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:25.879990 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [req-9bdc02fc-4029-4812-aee4-065d009ccb97 req-3dbd1ea5-f1c0-46a0-9943-c2912109007b service nova] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:25.889165 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.compute.server_external_events [req-9bdc02fc-4029-4812-aee4-065d009ccb97 req-3dbd1ea5-f1c0-46a0-9943-c2912109007b service nova] Creating event network-vif-deleted:9980b81a-c935-403b-b1f1-19c836209f02 for instance 75a258c9-7bf8-4872-8e94-5c4419dc474c on hv-cinder-85069 Jul 21 23:08:25.893953 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [req-9bdc02fc-4029-4812-aee4-065d009ccb97 req-3dbd1ea5-f1c0-46a0-9943-c2912109007b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029007 Jul 21 23:08:25.894605 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 630/1300] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Jul 21 23:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:08:26.229886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:26.229886 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:26.237122 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:26.237502 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:26.238276 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:26.238707 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:26.304386 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.policy [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae2a190cf2ef4777a3838cbe9750afea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a2b49707184c4093e713f0bbc5b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124925) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:08:26.312554 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-b17045ea-caa0-406a-a64d-c07e7830cee2 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 200 len: 1225 microversion: 2.1 time: 0.087497 Jul 21 23:08:26.313134 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 671/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:26 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:08:27.330404 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:27.331115 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 75a258c9-7bf8-4872-8e94-5c4419dc474c] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:27.337825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.338282 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.339141 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.339573 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.352418 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] HTTP exception thrown: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Request method failure captured: Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c HTTP/1.1 Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dqzv0JlRkN5gVQzYFZNb1eD0A18XWfjk53IJ9ngf_2uVzUUJD_KNTkkfWNFePdoo8gECHz6zoZfHHmlKRkwxg4RySMFCTsptCY2SjYJrDNf5RZboPdzB8Qx29Sa-O3PuMvzSXEAgWIrRxoJkvpvvxiug9g73VYRaVtXmsBEsUay--w Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:08:27.354626 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_24a2b49707184c4093e713f0bbc5b00c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ae2a190cf2ef4777a3838cbe9750afea Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. Jul 21 23:08:27.356710 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '75a258c9-7bf8-4872-8e94-5c4419dc474c'} Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:27.360788 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. Jul 21 23:08:27.363108 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.364641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Returning 404 to user: Instance 75a258c9-7bf8-4872-8e94-5c4419dc474c could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:27.364641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-deb3aa49-4df4-498f-b87b-b481eb81507e tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c" status: 404 len: 111 microversion: 2.1 time: 0.030579 Jul 21 23:08:27.364641 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 631/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:27 2022] GET /compute/v2.1/servers/75a258c9-7bf8-4872-8e94-5c4419dc474c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:08:27.846763 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:27.847308 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.compute.api [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124925) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:27.853760 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.854215 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.855004 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.855437 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG oslo_concurrency.lockutils [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.869163 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.wsgi [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] HTTP exception thrown: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Request method failure captured: Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: request: DELETE /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 HTTP/1.1 Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept: application/json Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Accept-Encoding: identity Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Connection: close Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Length: 0 Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Content-Type: application/json Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Host: 10.222.0.52 Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Openstack-System-Scope: None Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Auth-Token: gAAAAABi2dqzv0JlRkN5gVQzYFZNb1eD0A18XWfjk53IJ9ngf_2uVzUUJD_KNTkkfWNFePdoo8gECHz6zoZfHHmlKRkwxg4RySMFCTsptCY2SjYJrDNf5RZboPdzB8Qx29Sa-O3PuMvzSXEAgWIrRxoJkvpvvxiug9g73VYRaVtXmsBEsUay--w Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Id: None Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Domain-Name: None Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Identity-Status: Confirmed Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Is-Admin-Project: True Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Id: default Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Domain-Name: Default Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Project-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Role: member,reader Jul 21 23:08:27.870901 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Roles: member,reader Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_24a2b49707184c4093e713f0bbc5b00c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-Tenant-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Id: default Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Domain-Name: Default Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Id: ae2a190cf2ef4777a3838cbe9750afea Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: X-User-Name: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: method: > Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: exception: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.872602 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: action_args: {'id': '404532b8-3cf9-4628-96f0-e9cc4d933460'} Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:27.873578 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.874998 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.876407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Returning 404 to user: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. {{(pid=124925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:27.876407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-1fd0b959-c161-4c6c-bb7e-0317d76e9e45 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "DELETE /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 404 len: 111 microversion: 2.1 time: 0.029450 Jul 21 23:08:27.876407 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 672/1303] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Jul 21 23:08:27 2022] DELETE /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:08:27.881178 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '>' {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:27.881804 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.compute.api [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] [instance: 404532b8-3cf9-4628-96f0-e9cc4d933460] Fetching instance by UUID {{(pid=124924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:08:27.888518 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.888974 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.889746 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:08:27.890189 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG oslo_concurrency.lockutils [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Lock "efb1614c-6e53-4961-af0f-ea703c25657e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:08:27.905446 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.wsgi [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] HTTP exception thrown: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Request method failure captured: Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: request: GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 HTTP/1.1 Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept: application/json Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Accept-Encoding: identity Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Connection: close Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Length: 0 Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Content-Type: application/json Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Host: 10.222.0.52 Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Openstack-System-Scope: None Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Auth-Token: gAAAAABi2dqzv0JlRkN5gVQzYFZNb1eD0A18XWfjk53IJ9ngf_2uVzUUJD_KNTkkfWNFePdoo8gECHz6zoZfHHmlKRkwxg4RySMFCTsptCY2SjYJrDNf5RZboPdzB8Qx29Sa-O3PuMvzSXEAgWIrRxoJkvpvvxiug9g73VYRaVtXmsBEsUay--w Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Id: None Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Domain-Name: None Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Identity-Status: Confirmed Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Is-Admin-Project: True Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Id: default Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Domain-Name: Default Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Project-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Role: member,reader Jul 21 23:08:27.906992 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Roles: member,reader Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_24a2b49707184c4093e713f0bbc5b00c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/24a2b49707184c4093e713f0bbc5b00c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Id: 24a2b49707184c4093e713f0bbc5b00c Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-Tenant-Name: tempest-TestVolumeBootPattern-702275152 Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Id: default Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Domain-Name: Default Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Id: ae2a190cf2ef4777a3838cbe9750afea Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: X-User-Name: tempest-TestVolumeBootPattern-702275152-project Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: method: > Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: exception: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.908832 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: action_args: {'id': '404532b8-3cf9-4628-96f0-e9cc4d933460'} Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: {{(pid=124924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:27.909668 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. Jul 21 23:08:27.911160 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: ERROR nova.api.openstack.wsgi Jul 21 23:08:27.912918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: DEBUG nova.api.openstack.wsgi [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Returning 404 to user: Instance 404532b8-3cf9-4628-96f0-e9cc4d933460 could not be found. {{(pid=124924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:27.912918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO nova.api.openstack.requestlog [None req-38f3a95c-4bdf-4b83-ad9d-daea8ea1e7b0 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460" status: 404 len: 111 microversion: 2.1 time: 0.031155 Jul 21 23:08:27.912918 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: [pid: 124924|app: 0|req: 632/1304] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Jul 21 23:08:27 2022] GET /compute/v2.1/servers/404532b8-3cf9-4628-96f0-e9cc4d933460 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:08:29.411563 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: DEBUG nova.api.openstack.wsgi [None req-a5223184-6057-4f6a-ac8d-3e1e3802ef66 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] Calling method '.version_select at 0x7fc5e84caee0>' {{(pid=124925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:29.504046 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO nova.api.openstack.requestlog [None req-a5223184-6057-4f6a-ac8d-3e1e3802ef66 tempest-TestVolumeBootPattern-702275152 tempest-TestVolumeBootPattern-702275152-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1895998263" status: 202 len: 0 microversion: 2.1 time: 0.096239 Jul 21 23:08:29.504682 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: [pid: 124925|app: 0|req: 673/1305] 10.222.0.52 () {58 vars in 1262 bytes} [Thu Jul 21 23:08:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1895998263 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:08:41.655289 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:08:41.655928 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:08:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:10:04.705825 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:10:04.706362 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:10:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:10:51.281234 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:10:51.281946 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:11:45.526470 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:11:45.527583 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:12:01.663345 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:12:01.664071 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:12:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:13:24.714630 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:13:24.715435 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:13:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:13:42.051073 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:13:42.051548 dv-cinder-850697-1-iscsi devstack@n-api.service[124925]: Thu Jul 21 23:13:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:13:42.291843 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:13:42.292408 dv-cinder-850697-1-iscsi devstack@n-api.service[124924]: Thu Jul 21 23:13:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!